Skip to content

Remove the full analysis from benchmark comments#8233

Merged
AdamGS merged 1 commit into
developfrom
adamg/remove-full-details
Jun 3, 2026
Merged

Remove the full analysis from benchmark comments#8233
AdamGS merged 1 commit into
developfrom
adamg/remove-full-details

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Summary

Turns out we ran into the maximum github comment size, so time to make it smaller.

@AdamGS
Remove full details
b1d8275 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS requested review from joseph-isaacs and myrrc June 3, 2026 12:33
@AdamGS AdamGS added changelog/ci action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jun 3, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 3, 2026
@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b1d8275 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.985x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 111566659 117273546 0.95
polarsignals_q01/datafusion:vortex-file-compressed 260079834 274205440 0.95
polarsignals_q02/datafusion:vortex-file-compressed 22359399 23769899 0.94
polarsignals_q03/datafusion:vortex-file-compressed 275873723 256415974 1.08
polarsignals_q04/datafusion:vortex-file-compressed 10262883 10499151 0.98
polarsignals_q05/datafusion:vortex-file-compressed 13797550 14697474 0.94
polarsignals_q06/datafusion:vortex-file-compressed 17901290 17445355 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13158621 12787201 1.03
polarsignals_q08/datafusion:vortex-file-compressed 392113098 405789526 0.97
polarsignals_q09/datafusion:vortex-file-compressed 10460172 10433184 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-2.9%, low confidence) · DuckDB No clear signal (-4.1%, environment too noisy confidence)
Vortex (geomean): 0.926x ➖
Parquet (geomean): 0.960x ➖
Shifts: Parquet (control) -4.0% · Median polish -6.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.913x ➖, 5↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5757501 6514639 0.88
fineweb_q01/datafusion:vortex-file-compressed 34081046 34791026 0.98
fineweb_q02/datafusion:vortex-file-compressed 🚀 37594796 44203088 0.85
fineweb_q03/datafusion:vortex-file-compressed 71398699 70815236 1.01
fineweb_q04/datafusion:vortex-file-compressed 294191751 301859404 0.97
fineweb_q05/datafusion:vortex-file-compressed 🚀 223918385 261812514 0.86
fineweb_q06/datafusion:vortex-file-compressed 52337627 57212626 0.91
fineweb_q07/datafusion:vortex-file-compressed 🚀 54975415 62043234 0.89
fineweb_q08/datafusion:vortex-file-compressed 🚀 20939398 23721010 0.88
datafusion / vortex-compact (0.972x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6486299 6245246 1.04
fineweb_q01/datafusion:vortex-compact 101209228 100551313 1.01
fineweb_q02/datafusion:vortex-compact 107549393 105763966 1.02
fineweb_q03/datafusion:vortex-compact 883785687 914625011 0.97
fineweb_q04/datafusion:vortex-compact 938388698 1009314573 0.93
fineweb_q05/datafusion:vortex-compact 848842883 886748298 0.96
fineweb_q06/datafusion:vortex-compact 481008809 492356518 0.98
fineweb_q07/datafusion:vortex-compact 499854836 505861589 0.99
fineweb_q08/datafusion:vortex-compact 🚀 20289562 23130389 0.88
datafusion / parquet (0.971x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 7573037 8477704 0.89
fineweb_q01/datafusion:parquet 301116145 305770082 0.98
fineweb_q02/datafusion:parquet 304281293 309237311 0.98
fineweb_q03/datafusion:parquet 296733681 294527804 1.01
fineweb_q04/datafusion:parquet 326813625 326685800 1.00
fineweb_q05/datafusion:parquet 305906761 323991650 0.94
fineweb_q06/datafusion:parquet 301032305 310415568 0.97
fineweb_q07/datafusion:parquet 288498090 299170053 0.96
fineweb_q08/datafusion:parquet 292390543 294730749 0.99
duckdb / vortex-file-compressed (0.907x ➖, 2↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3811975 4019353 0.95
fineweb_q01/duckdb:vortex-file-compressed 34266004 37373242 0.92
fineweb_q02/duckdb:vortex-file-compressed 42531316 40498078 1.05
fineweb_q03/duckdb:vortex-file-compressed 🚀 121095383 181163641 0.67
fineweb_q04/duckdb:vortex-file-compressed 286877378 295150084 0.97
fineweb_q05/duckdb:vortex-file-compressed 227496593 239119218 0.95
fineweb_q06/duckdb:vortex-file-compressed 53341131 58237016 0.92
fineweb_q07/duckdb:vortex-file-compressed 🚀 57154144 66680832 0.86
fineweb_q08/duckdb:vortex-file-compressed 23035561 24549516 0.94
duckdb / vortex-compact (0.914x ➖, 2↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4558804 4915727 0.93
fineweb_q01/duckdb:vortex-compact 🚀 112752474 134937001 0.84
fineweb_q02/duckdb:vortex-compact 110766982 118212945 0.94
fineweb_q03/duckdb:vortex-compact 880627693 967635824 0.91
fineweb_q04/duckdb:vortex-compact 926867911 980618186 0.95
fineweb_q05/duckdb:vortex-compact 822437163 897617004 0.92
fineweb_q06/duckdb:vortex-compact 472315916 502332301 0.94
fineweb_q07/duckdb:vortex-compact 496058952 530135972 0.94
fineweb_q08/duckdb:vortex-compact 🚀 20378135 22953765 0.89
duckdb / parquet (0.950x ➖, 2↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31914089 35405667 0.90
fineweb_q01/duckdb:parquet 🚀 88280033 98234013 0.90
fineweb_q02/duckdb:parquet 91849137 97007453 0.95
fineweb_q03/duckdb:parquet 🚀 326107650 367971857 0.89
fineweb_q04/duckdb:parquet 455725922 477127342 0.96
fineweb_q05/duckdb:parquet 423435246 427751364 0.99
fineweb_q06/duckdb:parquet 210636032 217135030 0.97
fineweb_q07/duckdb:parquet 221698819 225320094 0.98
fineweb_q08/duckdb:parquet 37409765 36384789 1.03
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 754.93 KB -0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.1%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-2.8%, environment too noisy confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): 0.950x ➖
Parquet (geomean): 0.958x ➖
Shifts: Parquet (control) -4.2% · Median polish -4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.936x ➖, 2↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49967803 52092305 0.96
tpch_q02/datafusion:vortex-file-compressed 23250825 24322013 0.96
tpch_q03/datafusion:vortex-file-compressed 27589306 29658089 0.93
tpch_q04/datafusion:vortex-file-compressed 20697779 21573908 0.96
tpch_q05/datafusion:vortex-file-compressed 🚀 49628702 55623964 0.89
tpch_q06/datafusion:vortex-file-compressed 🚀 9993830 11654456 0.86
tpch_q07/datafusion:vortex-file-compressed 55097523 58991651 0.93
tpch_q08/datafusion:vortex-file-compressed 40167379 43242247 0.93
tpch_q09/datafusion:vortex-file-compressed 52054333 55506457 0.94
tpch_q10/datafusion:vortex-file-compressed 44071579 46136301 0.96
tpch_q11/datafusion:vortex-file-compressed 16084398 17397069 0.92
tpch_q12/datafusion:vortex-file-compressed 24436408 25965897 0.94
tpch_q13/datafusion:vortex-file-compressed 26934626 28003918 0.96
tpch_q14/datafusion:vortex-file-compressed 15918976 17271752 0.92
tpch_q15/datafusion:vortex-file-compressed 24597890 25520690 0.96
tpch_q16/datafusion:vortex-file-compressed 19786011 21672051 0.91
tpch_q17/datafusion:vortex-file-compressed 67898704 71556766 0.95
tpch_q18/datafusion:vortex-file-compressed 87540853 90659880 0.97
tpch_q19/datafusion:vortex-file-compressed 20662559 21742051 0.95
tpch_q20/datafusion:vortex-file-compressed 29275924 31172020 0.94
tpch_q21/datafusion:vortex-file-compressed 71024737 77252744 0.92
tpch_q22/datafusion:vortex-file-compressed 11837399 12697442 0.93
datafusion / vortex-compact (0.958x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57483996 59345431 0.97
tpch_q02/datafusion:vortex-compact 25855315 27240913 0.95
tpch_q03/datafusion:vortex-compact 28941722 30156709 0.96
tpch_q04/datafusion:vortex-compact 22689336 23602516 0.96
tpch_q05/datafusion:vortex-compact 51695390 53403276 0.97
tpch_q06/datafusion:vortex-compact 12592214 13081104 0.96
tpch_q07/datafusion:vortex-compact 59237509 61774300 0.96
tpch_q08/datafusion:vortex-compact 42650935 44734643 0.95
tpch_q09/datafusion:vortex-compact 56124624 56267485 1.00
tpch_q10/datafusion:vortex-compact 45701405 48320995 0.95
tpch_q11/datafusion:vortex-compact 16826460 17760588 0.95
tpch_q12/datafusion:vortex-compact 31017715 31523462 0.98
tpch_q13/datafusion:vortex-compact 32132852 33256175 0.97
tpch_q14/datafusion:vortex-compact 18712935 19684323 0.95
tpch_q15/datafusion:vortex-compact 31192638 32437208 0.96
tpch_q16/datafusion:vortex-compact 🚀 23454232 26210128 0.89
tpch_q17/datafusion:vortex-compact 71508238 72090229 0.99
tpch_q18/datafusion:vortex-compact 84017641 88928472 0.94
tpch_q19/datafusion:vortex-compact 30406126 31281962 0.97
tpch_q20/datafusion:vortex-compact 33983942 36128284 0.94
tpch_q21/datafusion:vortex-compact 75326320 79014631 0.95
tpch_q22/datafusion:vortex-compact 12613107 13302122 0.95
datafusion / parquet (0.964x ➖, 1↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 130017866 115990823 1.12
tpch_q02/datafusion:parquet 61634327 65403012 0.94
tpch_q03/datafusion:parquet 70922416 73398379 0.97
tpch_q04/datafusion:parquet 43466073 45300944 0.96
tpch_q05/datafusion:parquet 93788908 97792037 0.96
tpch_q06/datafusion:parquet 41154255 40389969 1.02
tpch_q07/datafusion:parquet 106452610 109353302 0.97
tpch_q08/datafusion:parquet 98094720 101525889 0.97
tpch_q09/datafusion:parquet 128813088 133525870 0.96
tpch_q10/datafusion:parquet 109532557 117353059 0.93
tpch_q11/datafusion:parquet 40908866 43612765 0.94
tpch_q12/datafusion:parquet 77391952 79180164 0.98
tpch_q13/datafusion:parquet 198547420 215831675 0.92
tpch_q14/datafusion:parquet 46241852 48267092 0.96
tpch_q15/datafusion:parquet 57908832 63998016 0.90
tpch_q16/datafusion:parquet 41496266 43400296 0.96
tpch_q17/datafusion:parquet 🚀 126519381 156448795 0.81
tpch_q18/datafusion:parquet 164793880 172036284 0.96
tpch_q19/datafusion:parquet 🚨 80002233 63336596 1.26
tpch_q20/datafusion:parquet 70283739 73774317 0.95
tpch_q21/datafusion:parquet 134122320 147175844 0.91
tpch_q22/datafusion:parquet 30137763 32338759 0.93
datafusion / arrow (0.918x ➖, 6↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 50573102 65106898 0.78
tpch_q02/datafusion:arrow 🚀 18437276 20632294 0.89
tpch_q03/datafusion:arrow 29218775 31536782 0.93
tpch_q04/datafusion:arrow 24844482 27256069 0.91
tpch_q05/datafusion:arrow 83092863 78948318 1.05
tpch_q06/datafusion:arrow 21587920 20844576 1.04
tpch_q07/datafusion:arrow 103751914 108506620 0.96
tpch_q08/datafusion:arrow 🚀 41060786 47291971 0.87
tpch_q09/datafusion:arrow 🚀 62582115 73825828 0.85
tpch_q10/datafusion:arrow 🚀 45038741 54486103 0.83
tpch_q11/datafusion:arrow 9196462 9737299 0.94
tpch_q12/datafusion:arrow 52286783 57134185 0.92
tpch_q13/datafusion:arrow 46744515 48485810 0.96
tpch_q14/datafusion:arrow 21609443 23760391 0.91
tpch_q15/datafusion:arrow 🚀 41977557 48225522 0.87
tpch_q16/datafusion:arrow 18970772 19904017 0.95
tpch_q17/datafusion:arrow 68529079 73870917 0.93
tpch_q18/datafusion:arrow 135610161 146760867 0.92
tpch_q19/datafusion:arrow 35456351 38177185 0.93
tpch_q20/datafusion:arrow 33913050 36904558 0.92
tpch_q21/datafusion:arrow 153003953 164530345 0.93
tpch_q22/datafusion:arrow 17745557 18706663 0.95
duckdb / vortex-file-compressed (0.953x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31540747 32050216 0.98
tpch_q02/duckdb:vortex-file-compressed 25679853 26669925 0.96
tpch_q03/duckdb:vortex-file-compressed 32310245 34170667 0.95
tpch_q04/duckdb:vortex-file-compressed 28357913 30126446 0.94
tpch_q05/duckdb:vortex-file-compressed 37798967 39676784 0.95
tpch_q06/duckdb:vortex-file-compressed 8111515 8906442 0.91
tpch_q07/duckdb:vortex-file-compressed 34916889 36972909 0.94
tpch_q08/duckdb:vortex-file-compressed 36810743 38989280 0.94
tpch_q09/duckdb:vortex-file-compressed 58596687 60197641 0.97
tpch_q10/duckdb:vortex-file-compressed 40823226 42197159 0.97
tpch_q11/duckdb:vortex-file-compressed 15262775 15462572 0.99
tpch_q12/duckdb:vortex-file-compressed 23026986 22754646 1.01
tpch_q13/duckdb:vortex-file-compressed 41496506 43504303 0.95
tpch_q14/duckdb:vortex-file-compressed 21901236 22871776 0.96
tpch_q15/duckdb:vortex-file-compressed 17067824 17554955 0.97
tpch_q16/duckdb:vortex-file-compressed 29122050 31287695 0.93
tpch_q17/duckdb:vortex-file-compressed 23852553 25741243 0.93
tpch_q18/duckdb:vortex-file-compressed 52441212 55282166 0.95
tpch_q19/duckdb:vortex-file-compressed 28807650 31164009 0.92
tpch_q20/duckdb:vortex-file-compressed 33061046 35647139 0.93
tpch_q21/duckdb:vortex-file-compressed 100098248 105720516 0.95
tpch_q22/duckdb:vortex-file-compressed 17248325 18044460 0.96
duckdb / vortex-compact (0.953x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38475718 39717697 0.97
tpch_q02/duckdb:vortex-compact 33837100 34629555 0.98
tpch_q03/duckdb:vortex-compact 34322325 36789999 0.93
tpch_q04/duckdb:vortex-compact 31489676 31980403 0.98
tpch_q05/duckdb:vortex-compact 41183589 44211014 0.93
tpch_q06/duckdb:vortex-compact 10541386 10973617 0.96
tpch_q07/duckdb:vortex-compact 40227756 43194519 0.93
tpch_q08/duckdb:vortex-compact 42645742 43025857 0.99
tpch_q09/duckdb:vortex-compact 65006807 68129327 0.95
tpch_q10/duckdb:vortex-compact 44964767 49887074 0.90
tpch_q11/duckdb:vortex-compact 18350796 18938067 0.97
tpch_q12/duckdb:vortex-compact 29109040 30691309 0.95
tpch_q13/duckdb:vortex-compact 47127947 48765145 0.97
tpch_q14/duckdb:vortex-compact 25935172 27807425 0.93
tpch_q15/duckdb:vortex-compact 19679380 20438707 0.96
tpch_q16/duckdb:vortex-compact 32993954 33570413 0.98
tpch_q17/duckdb:vortex-compact 29186624 31242314 0.93
tpch_q18/duckdb:vortex-compact 53765291 55231938 0.97
tpch_q19/duckdb:vortex-compact 32899262 35207610 0.93
tpch_q20/duckdb:vortex-compact 39455695 42771028 0.92
tpch_q21/duckdb:vortex-compact 103200196 109328686 0.94
tpch_q22/duckdb:vortex-compact 18508809 19053475 0.97
duckdb / parquet (0.951x ➖, 4↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78563958 79478473 0.99
tpch_q02/duckdb:parquet 39335283 40192819 0.98
tpch_q03/duckdb:parquet 71070920 72130190 0.99
tpch_q04/duckdb:parquet 52009319 50878025 1.02
tpch_q05/duckdb:parquet 67705863 70003009 0.97
tpch_q06/duckdb:parquet 22092961 22800402 0.97
tpch_q07/duckdb:parquet 76252110 84009722 0.91
tpch_q08/duckdb:parquet 84204665 87080759 0.97
tpch_q09/duckdb:parquet 🚀 133455795 151263041 0.88
tpch_q10/duckdb:parquet 131984206 133590432 0.99
tpch_q11/duckdb:parquet 22167914 23367161 0.95
tpch_q12/duckdb:parquet 🚀 52194765 59945558 0.87
tpch_q13/duckdb:parquet 250152010 268248118 0.93
tpch_q14/duckdb:parquet 50904431 53057648 0.96
tpch_q15/duckdb:parquet 26071254 26746787 0.97
tpch_q16/duckdb:parquet 57852729 61352864 0.94
tpch_q17/duckdb:parquet 🚀 54786295 62913538 0.87
tpch_q18/duckdb:parquet 119013130 123119140 0.97
tpch_q19/duckdb:parquet 73781697 73895062 1.00
tpch_q20/duckdb:parquet 65736155 67028178 0.98
tpch_q21/duckdb:parquet 🚀 168870135 194047316 0.87
tpch_q22/duckdb:parquet 53164295 54659245 0.97
duckdb / duckdb (0.966x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17785834 17965225 0.99
tpch_q02/duckdb:duckdb 14095830 15391229 0.92
tpch_q03/duckdb:duckdb 22440417 24250634 0.93
tpch_q04/duckdb:duckdb 22434447 23591908 0.95
tpch_q05/duckdb:duckdb 23346381 24092990 0.97
tpch_q06/duckdb:duckdb 7077481 7210049 0.98
tpch_q07/duckdb:duckdb 25516066 26275570 0.97
tpch_q08/duckdb:duckdb 24416674 25181478 0.97
tpch_q09/duckdb:duckdb 57356194 60668042 0.95
tpch_q10/duckdb:duckdb 52020047 51638855 1.01
tpch_q11/duckdb:duckdb 7150124 7542005 0.95
tpch_q12/duckdb:duckdb 18115410 18398869 0.98
tpch_q13/duckdb:duckdb 39951409 40729991 0.98
tpch_q14/duckdb:duckdb 21096711 21986921 0.96
tpch_q15/duckdb:duckdb 13510426 13885127 0.97
tpch_q16/duckdb:duckdb 26385138 26752690 0.99
tpch_q17/duckdb:duckdb 16333344 16992022 0.96
tpch_q18/duckdb:duckdb 40531955 41381709 0.98
tpch_q19/duckdb:duckdb 30895531 32846281 0.94
tpch_q20/duckdb:duckdb 25006386 25755053 0.97
tpch_q21/duckdb:duckdb 62043675 63181286 0.98
tpch_q22/duckdb:duckdb 25634117 26319092 0.97
File Size Changes (9 files changed, +0.0% overall, 5↑ 4↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 1.0 vortex-file-compressed 605.34 KB 616.58 KB +11.23 KB +1.9%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 5.01 MB +34.89 KB +0.7%
partsupp_0.vortex 1.0 vortex-compact 20.75 MB 20.85 MB +108.27 KB +0.5%
orders_0.vortex 1.0 vortex-file-compressed 38.23 MB 38.28 MB +53.61 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.91 MB 8.91 MB +1.55 KB +0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.11 MB 85.11 MB 4.18 KB -0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 23.81 MB 23.80 MB 11.38 KB -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.66 MB 84.54 MB 120.77 KB -0.1%
part_0.vortex 1.0 vortex-compact 3.47 MB 3.42 MB 47.70 KB -1.3%

Totals:

  • vortex-compact: 190.17 MB → 190.23 MB (+0.0%)
  • vortex-file-compressed: 246.57 MB → 246.54 MB (-0.0%)

@codspeed-hq

codspeed-hq Bot commented Jun 3, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 20.94%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 7 improved benchmarks
❌ 1 regressed benchmark
✅ 1267 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 275.3 ns -10.6%
⚡ Simulation chunked_bool_canonical_into[(1000, 10)] 45.4 µs 30.4 µs +49.27%
⚡ Simulation baseline_eq[4, 65536] 237.8 µs 185 µs +28.55%
⚡ Simulation baseline_lt[16, 65536] 275.4 µs 217.5 µs +26.63%
⚡ Simulation baseline_lt[4, 65536] 253 µs 200.8 µs +26.01%
⚡ Simulation chunked_varbinview_canonical_into[(1000, 10)] 197.7 µs 161.4 µs +22.44%
⚡ Simulation chunked_varbinview_into_canonical[(1000, 10)] 212.3 µs 176 µs +20.64%
⚡ Simulation baseline_eq[16, 65536] 260.2 µs 229.8 µs +13.23%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/remove-full-details (b1d8275) with develop (7a53ad5)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.1%, environment too noisy confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 0.975x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.954x ➖, 13↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 26727636 29945755 0.89
tpcds_q02/datafusion:vortex-file-compressed 47915958 52099453 0.92
tpcds_q03/datafusion:vortex-file-compressed 🚀 15500885 17439040 0.89
tpcds_q04/datafusion:vortex-file-compressed 🚀 260577492 290637407 0.90
tpcds_q05/datafusion:vortex-file-compressed 43351745 47664070 0.91
tpcds_q06/datafusion:vortex-file-compressed 59000854 60937108 0.97
tpcds_q07/datafusion:vortex-file-compressed 42943328 46827094 0.92
tpcds_q08/datafusion:vortex-file-compressed 🚀 29380281 33119843 0.89
tpcds_q09/datafusion:vortex-file-compressed 38172700 42072134 0.91
tpcds_q10/datafusion:vortex-file-compressed 🚀 37128464 44054420 0.84
tpcds_q11/datafusion:vortex-file-compressed 🚀 127090791 148208321 0.86
tpcds_q12/datafusion:vortex-file-compressed 🚀 21140196 23791830 0.89
tpcds_q13/datafusion:vortex-file-compressed 49986085 54084235 0.92
tpcds_q14/datafusion:vortex-file-compressed 🚀 170944341 193801117 0.88
tpcds_q15/datafusion:vortex-file-compressed 28813231 31939928 0.90
tpcds_q16/datafusion:vortex-file-compressed 🚀 28455419 34764330 0.82
tpcds_q17/datafusion:vortex-file-compressed 🚀 64334796 73141869 0.88
tpcds_q18/datafusion:vortex-file-compressed 🚀 68796167 79250204 0.87
tpcds_q19/datafusion:vortex-file-compressed 22292012 24394574 0.91
tpcds_q20/datafusion:vortex-file-compressed 22068474 23797453 0.93
tpcds_q21/datafusion:vortex-file-compressed 36356729 38995310 0.93
tpcds_q22/datafusion:vortex-file-compressed 🚀 111597042 167426266 0.67
tpcds_q23/datafusion:vortex-file-compressed 154866725 170465945 0.91
tpcds_q24/datafusion:vortex-file-compressed 85717019 94368193 0.91
tpcds_q25/datafusion:vortex-file-compressed 68021813 68701939 0.99
tpcds_q26/datafusion:vortex-file-compressed 34310957 37490996 0.92
tpcds_q27/datafusion:vortex-file-compressed 102433321 111744556 0.92
tpcds_q28/datafusion:vortex-file-compressed 33622982 34334281 0.98
tpcds_q29/datafusion:vortex-file-compressed 66007080 67889038 0.97
tpcds_q30/datafusion:vortex-file-compressed 24200140 25364832 0.95
tpcds_q31/datafusion:vortex-file-compressed 75143135 75283329 1.00
tpcds_q32/datafusion:vortex-file-compressed 21495739 21165305 1.02
tpcds_q33/datafusion:vortex-file-compressed 30322250 31682229 0.96
tpcds_q34/datafusion:vortex-file-compressed 24458242 25560844 0.96
tpcds_q35/datafusion:vortex-file-compressed 45807793 46506498 0.98
tpcds_q36/datafusion:vortex-file-compressed 58192831 59821785 0.97
tpcds_q37/datafusion:vortex-file-compressed 25028603 25146268 1.00
tpcds_q38/datafusion:vortex-file-compressed 44516881 45780400 0.97
tpcds_q39/datafusion:vortex-file-compressed 104906983 109914781 0.95
tpcds_q40/datafusion:vortex-file-compressed 33523802 33176412 1.01
tpcds_q41/datafusion:vortex-file-compressed 16214044 16587901 0.98
tpcds_q42/datafusion:vortex-file-compressed 14381306 15100422 0.95
tpcds_q43/datafusion:vortex-file-compressed 19200507 19268388 1.00
tpcds_q44/datafusion:vortex-file-compressed 32347158 31731390 1.02
tpcds_q45/datafusion:vortex-file-compressed 28917531 28728490 1.01
tpcds_q46/datafusion:vortex-file-compressed 34766068 35832765 0.97
tpcds_q47/datafusion:vortex-file-compressed 132491077 137562005 0.96
tpcds_q48/datafusion:vortex-file-compressed 36173444 37276352 0.97
tpcds_q49/datafusion:vortex-file-compressed 61241377 58690332 1.04
tpcds_q50/datafusion:vortex-file-compressed 39866065 41443528 0.96
tpcds_q51/datafusion:vortex-file-compressed 88090775 89859763 0.98
tpcds_q52/datafusion:vortex-file-compressed 15489249 15026342 1.03
tpcds_q53/datafusion:vortex-file-compressed 21836590 22311043 0.98
tpcds_q54/datafusion:vortex-file-compressed 37308717 36285625 1.03
tpcds_q55/datafusion:vortex-file-compressed 14277184 15246603 0.94
tpcds_q56/datafusion:vortex-file-compressed 30471159 32528392 0.94
tpcds_q57/datafusion:vortex-file-compressed 107636502 107302486 1.00
tpcds_q58/datafusion:vortex-file-compressed 53823031 54089615 1.00
tpcds_q59/datafusion:vortex-file-compressed 56805154 57953533 0.98
tpcds_q60/datafusion:vortex-file-compressed 30610902 30697447 1.00
tpcds_q61/datafusion:vortex-file-compressed 40980206 41461008 0.99
tpcds_q62/datafusion:vortex-file-compressed 🚀 22721876 27794231 0.82
tpcds_q63/datafusion:vortex-file-compressed 22256642 22285573 1.00
tpcds_q64/datafusion:vortex-file-compressed 431911030 420824764 1.03
tpcds_q65/datafusion:vortex-file-compressed 40186333 40180538 1.00
tpcds_q66/datafusion:vortex-file-compressed 74502172 74961393 0.99
tpcds_q67/datafusion:vortex-file-compressed 150146894 147684908 1.02
tpcds_q68/datafusion:vortex-file-compressed 33221136 34252180 0.97
tpcds_q69/datafusion:vortex-file-compressed 35736829 37608473 0.95
tpcds_q70/datafusion:vortex-file-compressed 86934117 88348965 0.98
tpcds_q71/datafusion:vortex-file-compressed 23365321 23323460 1.00
tpcds_q72/datafusion:vortex-file-compressed 2197431466 2263460877 0.97
tpcds_q73/datafusion:vortex-file-compressed 23637007 24131745 0.98
tpcds_q74/datafusion:vortex-file-compressed 80953700 84706172 0.96
tpcds_q75/datafusion:vortex-file-compressed 110860999 112849249 0.98
tpcds_q76/datafusion:vortex-file-compressed 31611454 33034469 0.96
tpcds_q77/datafusion:vortex-file-compressed 40167546 42598618 0.94
tpcds_q78/datafusion:vortex-file-compressed 125275043 132060675 0.95
tpcds_q79/datafusion:vortex-file-compressed 28818975 29754264 0.97
tpcds_q80/datafusion:vortex-file-compressed 94086119 96360548 0.98
tpcds_q81/datafusion:vortex-file-compressed 25284793 25003022 1.01
tpcds_q82/datafusion:vortex-file-compressed 26732442 26330970 1.02
tpcds_q83/datafusion:vortex-file-compressed 34208289 37446383 0.91
tpcds_q84/datafusion:vortex-file-compressed 13393311 13672737 0.98
tpcds_q85/datafusion:vortex-file-compressed 93152143 94838153 0.98
tpcds_q86/datafusion:vortex-file-compressed 17806248 16942851 1.05
tpcds_q87/datafusion:vortex-file-compressed 44411221 48720789 0.91
tpcds_q88/datafusion:vortex-file-compressed 57353329 59168042 0.97
tpcds_q89/datafusion:vortex-file-compressed 25239045 25600933 0.99
tpcds_q90/datafusion:vortex-file-compressed 14126111 15351124 0.92
tpcds_q91/datafusion:vortex-file-compressed 18656622 19518809 0.96
tpcds_q92/datafusion:vortex-file-compressed 19115233 19436808 0.98
tpcds_q93/datafusion:vortex-file-compressed 34686374 33822967 1.03
tpcds_q94/datafusion:vortex-file-compressed 23220200 24059488 0.97
tpcds_q95/datafusion:vortex-file-compressed 62059289 62741591 0.99
tpcds_q96/datafusion:vortex-file-compressed 13734835 13895272 0.99
tpcds_q97/datafusion:vortex-file-compressed 31615421 32496800 0.97
tpcds_q98/datafusion:vortex-file-compressed 24728257 24633992 1.00
tpcds_q99/datafusion:vortex-file-compressed 28527983 29445470 0.97
datafusion / vortex-compact (0.987x ➖, 4↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25996528 26539396 0.98
tpcds_q02/datafusion:vortex-compact 53684617 54500439 0.99
tpcds_q03/datafusion:vortex-compact 20442596 19797791 1.03
tpcds_q04/datafusion:vortex-compact 298561400 310487240 0.96
tpcds_q05/datafusion:vortex-compact 47812175 48958002 0.98
tpcds_q06/datafusion:vortex-compact 63761122 62921523 1.01
tpcds_q07/datafusion:vortex-compact 55394104 53792128 1.03
tpcds_q08/datafusion:vortex-compact 35487022 36506174 0.97
tpcds_q09/datafusion:vortex-compact 51696104 52303242 0.99
tpcds_q10/datafusion:vortex-compact 51774298 49990163 1.04
tpcds_q11/datafusion:vortex-compact 152851848 158309595 0.97
tpcds_q12/datafusion:vortex-compact 🚨 30455741 24923929 1.22
tpcds_q13/datafusion:vortex-compact 🚀 126628008 166195719 0.76
tpcds_q14/datafusion:vortex-compact 203144277 202875259 1.00
tpcds_q15/datafusion:vortex-compact 31127750 31267173 1.00
tpcds_q16/datafusion:vortex-compact 34085186 33779429 1.01
tpcds_q17/datafusion:vortex-compact 77892082 77528888 1.00
tpcds_q18/datafusion:vortex-compact 79217170 79307737 1.00
tpcds_q19/datafusion:vortex-compact 29816675 29818599 1.00
tpcds_q20/datafusion:vortex-compact 26254038 27786309 0.94
tpcds_q21/datafusion:vortex-compact 39731612 40967037 0.97
tpcds_q22/datafusion:vortex-compact 126192140 138652319 0.91
tpcds_q23/datafusion:vortex-compact 164888161 169711744 0.97
tpcds_q24/datafusion:vortex-compact 102481717 103084913 0.99
tpcds_q25/datafusion:vortex-compact 79232115 80932602 0.98
tpcds_q26/datafusion:vortex-compact 43758499 45851523 0.95
tpcds_q27/datafusion:vortex-compact 130654074 126393793 1.03
tpcds_q28/datafusion:vortex-compact 100772832 108023133 0.93
tpcds_q29/datafusion:vortex-compact 75634762 75382840 1.00
tpcds_q30/datafusion:vortex-compact 27337849 29500421 0.93
tpcds_q31/datafusion:vortex-compact 99834290 102429870 0.97
tpcds_q32/datafusion:vortex-compact 25345994 26113311 0.97
tpcds_q33/datafusion:vortex-compact 37282628 37079502 1.01
tpcds_q34/datafusion:vortex-compact 33469466 35175353 0.95
tpcds_q35/datafusion:vortex-compact 51406101 53917462 0.95
tpcds_q36/datafusion:vortex-compact 76439530 79827336 0.96
tpcds_q37/datafusion:vortex-compact 33930377 34815743 0.97
tpcds_q38/datafusion:vortex-compact 50611655 52644654 0.96
tpcds_q39/datafusion:vortex-compact 115248351 121937002 0.95
tpcds_q40/datafusion:vortex-compact 36271687 36927618 0.98
tpcds_q41/datafusion:vortex-compact 18538383 18434761 1.01
tpcds_q42/datafusion:vortex-compact 18134126 18802054 0.96
tpcds_q43/datafusion:vortex-compact 25480853 25253894 1.01
tpcds_q44/datafusion:vortex-compact 48097135 50325110 0.96
tpcds_q45/datafusion:vortex-compact 32871032 33037992 0.99
tpcds_q46/datafusion:vortex-compact 45080175 46472296 0.97
tpcds_q47/datafusion:vortex-compact 152600098 154718411 0.99
tpcds_q48/datafusion:vortex-compact 82048972 84640066 0.97
tpcds_q49/datafusion:vortex-compact 72337736 74118552 0.98
tpcds_q50/datafusion:vortex-compact 47332272 49277457 0.96
tpcds_q51/datafusion:vortex-compact 94997696 102746749 0.92
tpcds_q52/datafusion:vortex-compact 🚀 19663405 22561619 0.87
tpcds_q53/datafusion:vortex-compact 28780447 29640496 0.97
tpcds_q54/datafusion:vortex-compact 43238009 42718843 1.01
tpcds_q55/datafusion:vortex-compact 18778220 18662846 1.01
tpcds_q56/datafusion:vortex-compact 36929368 36191137 1.02
tpcds_q57/datafusion:vortex-compact 117992511 116894661 1.01
tpcds_q58/datafusion:vortex-compact 65729492 63601799 1.03
tpcds_q59/datafusion:vortex-compact 69867392 69982710 1.00
tpcds_q60/datafusion:vortex-compact 37723310 36468282 1.03
tpcds_q61/datafusion:vortex-compact 56235553 55818881 1.01
tpcds_q62/datafusion:vortex-compact 🚀 24018209 28470082 0.84
tpcds_q63/datafusion:vortex-compact 27955573 29082978 0.96
tpcds_q64/datafusion:vortex-compact 467035933 464687624 1.01
tpcds_q65/datafusion:vortex-compact 54704699 54267234 1.01
tpcds_q66/datafusion:vortex-compact 78957327 75340000 1.05
tpcds_q67/datafusion:vortex-compact 161833421 154663953 1.05
tpcds_q68/datafusion:vortex-compact 47145108 45969511 1.03
tpcds_q69/datafusion:vortex-compact 48791139 48218101 1.01
tpcds_q70/datafusion:vortex-compact 96418328 99634339 0.97
tpcds_q71/datafusion:vortex-compact 29092043 30804771 0.94
tpcds_q72/datafusion:vortex-compact 2185486009 2233197611 0.98
tpcds_q73/datafusion:vortex-compact 31784762 30906616 1.03
tpcds_q74/datafusion:vortex-compact 95392673 93082215 1.02
tpcds_q75/datafusion:vortex-compact 130917493 132118563 0.99
tpcds_q76/datafusion:vortex-compact 32820179 32053009 1.02
tpcds_q77/datafusion:vortex-compact 50474802 50699997 1.00
tpcds_q78/datafusion:vortex-compact 145355046 140424287 1.04
tpcds_q79/datafusion:vortex-compact 37857462 38337032 0.99
tpcds_q80/datafusion:vortex-compact 109942867 107008464 1.03
tpcds_q81/datafusion:vortex-compact 27683018 27768822 1.00
tpcds_q82/datafusion:vortex-compact 34811368 34406954 1.01
tpcds_q83/datafusion:vortex-compact 34880689 34303432 1.02
tpcds_q84/datafusion:vortex-compact 15052643 14582957 1.03
tpcds_q85/datafusion:vortex-compact 165084585 162415100 1.02
tpcds_q86/datafusion:vortex-compact 20454327 18729428 1.09
tpcds_q87/datafusion:vortex-compact 52031581 53987025 0.96
tpcds_q88/datafusion:vortex-compact 78431944 77964479 1.01
tpcds_q89/datafusion:vortex-compact 31197975 31051127 1.00
tpcds_q90/datafusion:vortex-compact 15376213 14998031 1.03
tpcds_q91/datafusion:vortex-compact 32920812 31887671 1.03
tpcds_q92/datafusion:vortex-compact 24201081 25215899 0.96
tpcds_q93/datafusion:vortex-compact 39371978 42852676 0.92
tpcds_q94/datafusion:vortex-compact 🚀 26560431 29727145 0.89
tpcds_q95/datafusion:vortex-compact 67527633 67780332 1.00
tpcds_q96/datafusion:vortex-compact 17216055 17761595 0.97
tpcds_q97/datafusion:vortex-compact 35864985 37071768 0.97
tpcds_q98/datafusion:vortex-compact 32242875 30259646 1.07
tpcds_q99/datafusion:vortex-compact 35494086 35618210 1.00
datafusion / parquet (0.971x ➖, 17↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31660738 33601861 0.94
tpcds_q02/datafusion:parquet 42286500 45522796 0.93
tpcds_q03/datafusion:parquet 13491740 13863228 0.97
tpcds_q04/datafusion:parquet 🚀 264635892 312279690 0.85
tpcds_q05/datafusion:parquet 42201639 44985979 0.94
tpcds_q06/datafusion:parquet 58615462 60379037 0.97
tpcds_q07/datafusion:parquet 79577621 76697738 1.04
tpcds_q08/datafusion:parquet 27098877 26686223 1.02
tpcds_q09/datafusion:parquet 46105983 43735925 1.05
tpcds_q10/datafusion:parquet 🚨 76245704 68482843 1.11
tpcds_q11/datafusion:parquet 154546831 150541341 1.03
tpcds_q12/datafusion:parquet 17199238 16597379 1.04
tpcds_q13/datafusion:parquet 75861594 76648598 0.99
tpcds_q14/datafusion:parquet 163665698 165989193 0.99
tpcds_q15/datafusion:parquet 21962007 22221433 0.99
tpcds_q16/datafusion:parquet 27959603 25429271 1.10
tpcds_q17/datafusion:parquet 62954283 67455435 0.93
tpcds_q18/datafusion:parquet 114152079 115356994 0.99
tpcds_q19/datafusion:parquet 22406807 23089590 0.97
tpcds_q20/datafusion:parquet 16684180 16227190 1.03
tpcds_q21/datafusion:parquet 18627365 20365698 0.91
tpcds_q22/datafusion:parquet 144926230 141555289 1.02
tpcds_q23/datafusion:parquet 148311498 145402573 1.02
tpcds_q24/datafusion:parquet 92849488 89617736 1.04
tpcds_q25/datafusion:parquet 65067270 64027842 1.02
tpcds_q26/datafusion:parquet 64456268 65391878 0.99
tpcds_q27/datafusion:parquet 148058616 144958633 1.02
tpcds_q28/datafusion:parquet 44213785 43681382 1.01
tpcds_q29/datafusion:parquet 67062405 66074263 1.01
tpcds_q30/datafusion:parquet 34506416 36694890 0.94
tpcds_q31/datafusion:parquet 64410145 65192666 0.99
tpcds_q32/datafusion:parquet 18011610 19014063 0.95
tpcds_q33/datafusion:parquet 28356254 27608088 1.03
tpcds_q34/datafusion:parquet 22559757 22178712 1.02
tpcds_q35/datafusion:parquet 68160729 70354941 0.97
tpcds_q36/datafusion:parquet 58223731 56795202 1.03
tpcds_q37/datafusion:parquet 20276938 18643354 1.09
tpcds_q38/datafusion:parquet 41549226 44181477 0.94
tpcds_q39/datafusion:parquet 77239105 75440422 1.02
tpcds_q40/datafusion:parquet 24591501 23564891 1.04
tpcds_q41/datafusion:parquet 14204640 12999061 1.09
tpcds_q42/datafusion:parquet 11480702 11306630 1.02
tpcds_q43/datafusion:parquet 17350174 16773893 1.03
tpcds_q44/datafusion:parquet 33665034 33245169 1.01
tpcds_q45/datafusion:parquet 28362351 28389710 1.00
tpcds_q46/datafusion:parquet 32939225 33021662 1.00
tpcds_q47/datafusion:parquet 126854117 127331385 1.00
tpcds_q48/datafusion:parquet 70290260 68103068 1.03
tpcds_q49/datafusion:parquet 55823597 56484042 0.99
tpcds_q50/datafusion:parquet 44133959 44566139 0.99
tpcds_q51/datafusion:parquet 87194058 85936186 1.01
tpcds_q52/datafusion:parquet 12827311 11765450 1.09
tpcds_q53/datafusion:parquet 17464486 19074105 0.92
tpcds_q54/datafusion:parquet 34239969 35012989 0.98
tpcds_q55/datafusion:parquet 11489236 11160331 1.03
tpcds_q56/datafusion:parquet 27889504 26934804 1.04
tpcds_q57/datafusion:parquet 103845001 99990957 1.04
tpcds_q58/datafusion:parquet 51029826 50998201 1.00
tpcds_q59/datafusion:parquet 58298215 57759863 1.01
tpcds_q60/datafusion:parquet 29262608 27768343 1.05
tpcds_q61/datafusion:parquet 43597854 42923915 1.02
tpcds_q62/datafusion:parquet 20720359 21017080 0.99
tpcds_q63/datafusion:parquet 17207602 17644859 0.98
tpcds_q64/datafusion:parquet 515173247 517033306 1.00
tpcds_q65/datafusion:parquet 37414888 37095919 1.01
tpcds_q66/datafusion:parquet 69024487 73602008 0.94
tpcds_q67/datafusion:parquet 139624651 154079892 0.91
tpcds_q68/datafusion:parquet 33439669 33314368 1.00
tpcds_q69/datafusion:parquet 66291968 67118096 0.99
tpcds_q70/datafusion:parquet 83699225 87664225 0.95
tpcds_q71/datafusion:parquet 23092246 22283834 1.04
tpcds_q72/datafusion:parquet 🚀 612287731 682357629 0.90
tpcds_q73/datafusion:parquet 20871045 22437722 0.93
tpcds_q74/datafusion:parquet 🚀 83843770 96144233 0.87
tpcds_q75/datafusion:parquet 🚀 96746640 109405045 0.88
tpcds_q76/datafusion:parquet 🚀 29585385 34398600 0.86
tpcds_q77/datafusion:parquet 39320844 42964991 0.92
tpcds_q78/datafusion:parquet 118280163 126019963 0.94
tpcds_q79/datafusion:parquet 30067082 30450910 0.99
tpcds_q80/datafusion:parquet 🚀 81039068 94081611 0.86
tpcds_q81/datafusion:parquet 🚀 31502743 35656957 0.88
tpcds_q82/datafusion:parquet 🚀 18962491 21740623 0.87
tpcds_q83/datafusion:parquet 🚀 36626527 41792000 0.88
tpcds_q84/datafusion:parquet 40526485 43468313 0.93
tpcds_q85/datafusion:parquet 149341512 160721381 0.93
tpcds_q86/datafusion:parquet 15873348 17476250 0.91
tpcds_q87/datafusion:parquet 41711607 45260129 0.92
tpcds_q88/datafusion:parquet 🚀 58883022 65525151 0.90
tpcds_q89/datafusion:parquet 21214612 22887249 0.93
tpcds_q90/datafusion:parquet 🚀 14316902 18105264 0.79
tpcds_q91/datafusion:parquet 🚀 57745873 66676969 0.87
tpcds_q92/datafusion:parquet 🚀 18748757 21432527 0.87
tpcds_q93/datafusion:parquet 🚀 31389502 37315395 0.84
tpcds_q94/datafusion:parquet 20792751 22090322 0.94
tpcds_q95/datafusion:parquet 60289690 66197815 0.91
tpcds_q96/datafusion:parquet 🚀 12101880 13753854 0.88
tpcds_q97/datafusion:parquet 🚀 29771680 33241258 0.90
tpcds_q98/datafusion:parquet 🚀 20996604 23625683 0.89
tpcds_q99/datafusion:parquet 🚨 33541076 29378257 1.14
duckdb / vortex-file-compressed (0.980x ➖, 3↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23344923 25603508 0.91
tpcds_q02/duckdb:vortex-file-compressed 33317839 36762851 0.91
tpcds_q03/duckdb:vortex-file-compressed 21677402 22980833 0.94
tpcds_q04/duckdb:vortex-file-compressed 95891194 93174029 1.03
tpcds_q05/duckdb:vortex-file-compressed 34801606 35521177 0.98
tpcds_q06/duckdb:vortex-file-compressed 32865150 33698789 0.98
tpcds_q07/duckdb:vortex-file-compressed 21283102 21780464 0.98
tpcds_q08/duckdb:vortex-file-compressed 26255173 27040788 0.97
tpcds_q09/duckdb:vortex-file-compressed 16330041 16276074 1.00
tpcds_q10/duckdb:vortex-file-compressed 36231232 38385750 0.94
tpcds_q11/duckdb:vortex-file-compressed 64342668 64887257 0.99
tpcds_q12/duckdb:vortex-file-compressed 16010959 16646942 0.96
tpcds_q13/duckdb:vortex-file-compressed 33625406 32596308 1.03
tpcds_q14/duckdb:vortex-file-compressed 99808351 97591895 1.02
tpcds_q15/duckdb:vortex-file-compressed 28743150 28814175 1.00
tpcds_q16/duckdb:vortex-file-compressed 26199584 28124126 0.93
tpcds_q17/duckdb:vortex-file-compressed 46601197 44860892 1.04
tpcds_q18/duckdb:vortex-file-compressed 36506031 37405628 0.98
tpcds_q19/duckdb:vortex-file-compressed 32015623 34369249 0.93
tpcds_q20/duckdb:vortex-file-compressed 17842660 17376560 1.03
tpcds_q21/duckdb:vortex-file-compressed 16319095 17540158 0.93
tpcds_q22/duckdb:vortex-file-compressed 🚀 71138541 79251650 0.90
tpcds_q23/duckdb:vortex-file-compressed 89800530 96900022 0.93
tpcds_q24/duckdb:vortex-file-compressed 47373140 47645355 0.99
tpcds_q25/duckdb:vortex-file-compressed 41166654 42665659 0.96
tpcds_q26/duckdb:vortex-file-compressed 🚨 21102091 19158918 1.10
tpcds_q27/duckdb:vortex-file-compressed 24276533 23577550 1.03
tpcds_q28/duckdb:vortex-file-compressed 12924530 12558815 1.03
tpcds_q29/duckdb:vortex-file-compressed 39872170 40081768 0.99
tpcds_q30/duckdb:vortex-file-compressed 25238847 26187288 0.96
tpcds_q31/duckdb:vortex-file-compressed 29666326 29145391 1.02
tpcds_q32/duckdb:vortex-file-compressed 13628066 13757221 0.99
tpcds_q33/duckdb:vortex-file-compressed 24461615 23937718 1.02
tpcds_q34/duckdb:vortex-file-compressed 24866604 24512963 1.01
tpcds_q35/duckdb:vortex-file-compressed 63986832 69938591 0.91
tpcds_q36/duckdb:vortex-file-compressed 24705034 25022827 0.99
tpcds_q37/duckdb:vortex-file-compressed 20105654 20139512 1.00
tpcds_q38/duckdb:vortex-file-compressed 39463853 36379255 1.08
tpcds_q39/duckdb:vortex-file-compressed 35724402 38618295 0.93
tpcds_q40/duckdb:vortex-file-compressed 20415023 20369594 1.00
tpcds_q41/duckdb:vortex-file-compressed 10579749 10505320 1.01
tpcds_q42/duckdb:vortex-file-compressed 13442408 13436049 1.00
tpcds_q43/duckdb:vortex-file-compressed 21087151 22285501 0.95
tpcds_q44/duckdb:vortex-file-compressed 🚀 20968825 23579596 0.89
tpcds_q45/duckdb:vortex-file-compressed 30088456 31279806 0.96
tpcds_q46/duckdb:vortex-file-compressed 31399096 32858401 0.96
tpcds_q47/duckdb:vortex-file-compressed 52086338 53335598 0.98
tpcds_q48/duckdb:vortex-file-compressed 28771757 30485380 0.94
tpcds_q49/duckdb:vortex-file-compressed 36353198 34453922 1.06
tpcds_q50/duckdb:vortex-file-compressed 25815707 25050399 1.03
tpcds_q51/duckdb:vortex-file-compressed 🚨 130801216 108799459 1.20
tpcds_q52/duckdb:vortex-file-compressed 13607200 13229914 1.03
tpcds_q53/duckdb:vortex-file-compressed 22369513 22781481 0.98
tpcds_q54/duckdb:vortex-file-compressed 28446878 29343512 0.97
tpcds_q55/duckdb:vortex-file-compressed 12756196 14033346 0.91
tpcds_q56/duckdb:vortex-file-compressed 25607804 26527963 0.97
tpcds_q57/duckdb:vortex-file-compressed 42388296 42562407 1.00
tpcds_q58/duckdb:vortex-file-compressed 29934772 30235155 0.99
tpcds_q59/duckdb:vortex-file-compressed 56593460 56893282 0.99
tpcds_q60/duckdb:vortex-file-compressed 27096321 25508526 1.06
tpcds_q61/duckdb:vortex-file-compressed 30823734 31301456 0.98
tpcds_q62/duckdb:vortex-file-compressed 15252630 16299901 0.94
tpcds_q63/duckdb:vortex-file-compressed 20865151 20598619 1.01
tpcds_q64/duckdb:vortex-file-compressed 94661728 95928683 0.99
tpcds_q65/duckdb:vortex-file-compressed 22353531 21990980 1.02
tpcds_q66/duckdb:vortex-file-compressed 30068938 31100325 0.97
tpcds_q67/duckdb:vortex-file-compressed 143460896 145974717 0.98
tpcds_q68/duckdb:vortex-file-compressed 29117871 32108763 0.91
tpcds_q69/duckdb:vortex-file-compressed 42861262 40830842 1.05
tpcds_q70/duckdb:vortex-file-compressed 37514935 36263140 1.03
tpcds_q71/duckdb:vortex-file-compressed 20399370 20211538 1.01
tpcds_q72/duckdb:vortex-file-compressed 171946189 178141892 0.97
tpcds_q73/duckdb:vortex-file-compressed 25004652 26374955 0.95
tpcds_q74/duckdb:vortex-file-compressed 43055031 42818742 1.01
tpcds_q75/duckdb:vortex-file-compressed 48949363 52998142 0.92
tpcds_q76/duckdb:vortex-file-compressed 21507723 20498725 1.05
tpcds_q77/duckdb:vortex-file-compressed 🚀 22985529 27848407 0.83
tpcds_q78/duckdb:vortex-file-compressed 76398772 82507980 0.93
tpcds_q79/duckdb:vortex-file-compressed 23928222 24124943 0.99
tpcds_q80/duckdb:vortex-file-compressed 46344414 50000025 0.93
tpcds_q81/duckdb:vortex-file-compressed 30253388 29948295 1.01
tpcds_q82/duckdb:vortex-file-compressed 46039288 45636337 1.01
tpcds_q83/duckdb:vortex-file-compressed 26445714 27349664 0.97
tpcds_q84/duckdb:vortex-file-compressed 17034045 18240590 0.93
tpcds_q85/duckdb:vortex-file-compressed 40759689 42781434 0.95
tpcds_q86/duckdb:vortex-file-compressed 16857141 17733924 0.95
tpcds_q87/duckdb:vortex-file-compressed 41392959 42629260 0.97
tpcds_q88/duckdb:vortex-file-compressed 50253746 51236217 0.98
tpcds_q89/duckdb:vortex-file-compressed 21823264 22197205 0.98
tpcds_q90/duckdb:vortex-file-compressed 10454181 10503802 1.00
tpcds_q91/duckdb:vortex-file-compressed 22109813 21972947 1.01
tpcds_q92/duckdb:vortex-file-compressed 18834403 19980153 0.94
tpcds_q93/duckdb:vortex-file-compressed 29066172 31749766 0.92
tpcds_q94/duckdb:vortex-file-compressed 21827756 22232602 0.98
tpcds_q95/duckdb:vortex-file-compressed 147549328 149347041 0.99
tpcds_q96/duckdb:vortex-file-compressed 12374459 13076351 0.95
tpcds_q97/duckdb:vortex-file-compressed 39576319 39069409 1.01
tpcds_q98/duckdb:vortex-file-compressed 19174817 19785336 0.97
tpcds_q99/duckdb:vortex-file-compressed 23019193 24555407 0.94
duckdb / vortex-compact (0.979x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25860609 27488236 0.94
tpcds_q02/duckdb:vortex-compact 40294122 40199194 1.00
tpcds_q03/duckdb:vortex-compact 49491454 51497711 0.96
tpcds_q04/duckdb:vortex-compact 101393298 106451055 0.95
tpcds_q05/duckdb:vortex-compact 40905460 43169001 0.95
tpcds_q06/duckdb:vortex-compact 38495711 40296968 0.96
tpcds_q07/duckdb:vortex-compact 34870122 35254955 0.99
tpcds_q08/duckdb:vortex-compact 42632672 40264818 1.06
tpcds_q09/duckdb:vortex-compact 20082550 20028527 1.00
tpcds_q10/duckdb:vortex-compact 51781879 54302812 0.95
tpcds_q11/duckdb:vortex-compact 75166631 75074625 1.00
tpcds_q12/duckdb:vortex-compact 21704207 23196883 0.94
tpcds_q13/duckdb:vortex-compact 52290027 53707988 0.97
tpcds_q14/duckdb:vortex-compact 119761931 121997949 0.98
tpcds_q15/duckdb:vortex-compact 30576376 30341411 1.01
tpcds_q16/duckdb:vortex-compact 26680695 27762844 0.96
tpcds_q17/duckdb:vortex-compact 58410286 54850922 1.06
tpcds_q18/duckdb:vortex-compact 49132861 50992438 0.96
tpcds_q19/duckdb:vortex-compact 43089942 45149777 0.95
tpcds_q20/duckdb:vortex-compact 21325447 21755930 0.98
tpcds_q21/duckdb:vortex-compact 19063191 20355223 0.94
tpcds_q22/duckdb:vortex-compact 75967587 79160988 0.96
tpcds_q23/duckdb:vortex-compact 109609793 113048413 0.97
tpcds_q24/duckdb:vortex-compact 57259283 59196793 0.97
tpcds_q25/duckdb:vortex-compact 54111151 54268828 1.00
tpcds_q26/duckdb:vortex-compact 30857516 34216503 0.90
tpcds_q27/duckdb:vortex-compact 36596571 36628938 1.00
tpcds_q28/duckdb:vortex-compact 35064021 34807256 1.01
tpcds_q29/duckdb:vortex-compact 55461800 54832072 1.01
tpcds_q30/duckdb:vortex-compact 30604549 31844910 0.96
tpcds_q31/duckdb:vortex-compact 37711309 34918510 1.08
tpcds_q32/duckdb:vortex-compact 21189945 21855136 0.97
tpcds_q33/duckdb:vortex-compact 33719485 34648266 0.97
tpcds_q34/duckdb:vortex-compact 30734401 31196514 0.99
tpcds_q35/duckdb:vortex-compact 74318418 76043028 0.98
tpcds_q36/duckdb:vortex-compact 35311222 37407777 0.94
tpcds_q37/duckdb:vortex-compact 24294350 24184573 1.00
tpcds_q38/duckdb:vortex-compact 42240134 42777578 0.99
tpcds_q39/duckdb:vortex-compact 37573699 38312532 0.98
tpcds_q40/duckdb:vortex-compact 26433154 25494491 1.04
tpcds_q41/duckdb:vortex-compact 11944465 12022984 0.99
tpcds_q42/duckdb:vortex-compact 20298109 20087981 1.01
tpcds_q43/duckdb:vortex-compact 31847365 33086005 0.96
tpcds_q44/duckdb:vortex-compact 28635064 29608656 0.97
tpcds_q45/duckdb:vortex-compact 37179847 40103280 0.93
tpcds_q46/duckdb:vortex-compact 43853634 46097119 0.95
tpcds_q47/duckdb:vortex-compact 63069368 67618610 0.93
tpcds_q48/duckdb:vortex-compact 44863792 47884830 0.94
tpcds_q49/duckdb:vortex-compact 45226297 50175075 0.90
tpcds_q50/duckdb:vortex-compact 37614210 38292275 0.98
tpcds_q51/duckdb:vortex-compact 113981057 115559229 0.99
tpcds_q52/duckdb:vortex-compact 19470850 19259920 1.01
tpcds_q53/duckdb:vortex-compact 33166894 33142930 1.00
tpcds_q54/duckdb:vortex-compact 38600444 37336706 1.03
tpcds_q55/duckdb:vortex-compact 18573419 18858264 0.98
tpcds_q56/duckdb:vortex-compact 32365648 32923825 0.98
tpcds_q57/duckdb:vortex-compact 46375645 46705958 0.99
tpcds_q58/duckdb:vortex-compact 36774105 40086508 0.92
tpcds_q59/duckdb:vortex-compact 65970252 67311892 0.98
tpcds_q60/duckdb:vortex-compact 35326956 37420507 0.94
tpcds_q61/duckdb:vortex-compact 54357532 55303955 0.98
tpcds_q62/duckdb:vortex-compact 21327099 21949083 0.97
tpcds_q63/duckdb:vortex-compact 31795601 31170490 1.02
tpcds_q64/duckdb:vortex-compact 128691680 130323822 0.99
tpcds_q65/duckdb:vortex-compact 30360040 31169530 0.97
tpcds_q66/duckdb:vortex-compact 35594962 36975066 0.96
tpcds_q67/duckdb:vortex-compact 148821477 154511008 0.96
tpcds_q68/duckdb:vortex-compact 45782984 48326057 0.95
tpcds_q69/duckdb:vortex-compact 54399054 56310470 0.97
tpcds_q70/duckdb:vortex-compact 57571757 59813352 0.96
tpcds_q71/duckdb:vortex-compact 29247591 29395861 0.99
tpcds_q72/duckdb:vortex-compact 184769268 190486525 0.97
tpcds_q73/duckdb:vortex-compact 28515700 28952407 0.98
tpcds_q74/duckdb:vortex-compact 49919268 48181116 1.04
tpcds_q75/duckdb:vortex-compact 64677100 62095322 1.04
tpcds_q76/duckdb:vortex-compact 🚀 29079712 33842245 0.86
tpcds_q77/duckdb:vortex-compact 36327615 37589750 0.97
tpcds_q78/duckdb:vortex-compact 90228267 87757297 1.03
tpcds_q79/duckdb:vortex-compact 41856467 40891293 1.02
tpcds_q80/duckdb:vortex-compact 70722214 71071625 1.00
tpcds_q81/duckdb:vortex-compact 35069508 34619554 1.01
tpcds_q82/duckdb:vortex-compact 50806767 49884586 1.02
tpcds_q83/duckdb:vortex-compact 36005841 35888093 1.00
tpcds_q84/duckdb:vortex-compact 21411403 21776908 0.98
tpcds_q85/duckdb:vortex-compact 52416120 54969816 0.95
tpcds_q86/duckdb:vortex-compact 21979311 20652913 1.06
tpcds_q87/duckdb:vortex-compact 44571128 47759266 0.93
tpcds_q88/duckdb:vortex-compact 76379212 77191971 0.99
tpcds_q89/duckdb:vortex-compact 32248682 33471902 0.96
tpcds_q90/duckdb:vortex-compact 11294011 11524120 0.98
tpcds_q91/duckdb:vortex-compact 41878677 43403267 0.96
tpcds_q92/duckdb:vortex-compact 42052831 40446037 1.04
tpcds_q93/duckdb:vortex-compact 32942851 33180647 0.99
tpcds_q94/duckdb:vortex-compact 27170585 29892518 0.91
tpcds_q95/duckdb:vortex-compact 164397355 167206483 0.98
tpcds_q96/duckdb:vortex-compact 17171739 17368191 0.99
tpcds_q97/duckdb:vortex-compact 41646778 42389338 0.98
tpcds_q98/duckdb:vortex-compact 26924875 27585366 0.98
tpcds_q99/duckdb:vortex-compact 26172690 27515389 0.95
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30351186 29224212 1.04
tpcds_q02/duckdb:parquet 24144644 23963244 1.01
tpcds_q03/duckdb:parquet 13005339 13229749 0.98
tpcds_q04/duckdb:parquet 173387595 168129944 1.03
tpcds_q05/duckdb:parquet 32252388 32204171 1.00
tpcds_q06/duckdb:parquet 34045498 34281107 0.99
tpcds_q07/duckdb:parquet 24206597 24610086 0.98
tpcds_q08/duckdb:parquet 29612821 29840553 0.99
tpcds_q09/duckdb:parquet 45023526 44415393 1.01
tpcds_q10/duckdb:parquet 37568109 37346051 1.01
tpcds_q11/duckdb:parquet 94797787 89997753 1.05
tpcds_q12/duckdb:parquet 17290130 17174317 1.01
tpcds_q13/duckdb:parquet 35233760 35355868 1.00
tpcds_q14/duckdb:parquet 103561230 102983317 1.01
tpcds_q15/duckdb:parquet 30987021 31306338 0.99
tpcds_q16/duckdb:parquet 22683126 22892166 0.99
tpcds_q17/duckdb:parquet 40589942 39996678 1.01
tpcds_q18/duckdb:parquet 48723714 49014966 0.99
tpcds_q19/duckdb:parquet 31483452 31766558 0.99
tpcds_q20/duckdb:parquet 18721485 18924420 0.99
tpcds_q21/duckdb:parquet 11885339 12232394 0.97
tpcds_q22/duckdb:parquet 74542121 69294238 1.08
tpcds_q23/duckdb:parquet 82008765 80314039 1.02
tpcds_q24/duckdb:parquet 46905211 46856305 1.00
tpcds_q25/duckdb:parquet 36275839 35941319 1.01
tpcds_q26/duckdb:parquet 40401413 40285262 1.00
tpcds_q27/duckdb:parquet 52491988 53340453 0.98
tpcds_q28/duckdb:parquet 43481215 43066399 1.01
tpcds_q29/duckdb:parquet 39290181 39425648 1.00
tpcds_q30/duckdb:parquet 37746929 37683137 1.00
tpcds_q31/duckdb:parquet 28280333 28821246 0.98
tpcds_q32/duckdb:parquet 13117950 12940605 1.01
tpcds_q33/duckdb:parquet 23747381 23583485 1.01
tpcds_q34/duckdb:parquet 23367577 22880696 1.02
tpcds_q35/duckdb:parquet 62135599 61677831 1.01
tpcds_q36/duckdb:parquet 22556843 22783633 0.99
tpcds_q37/duckdb:parquet 14501418 14798706 0.98
tpcds_q38/duckdb:parquet 37099320 36953963 1.00
tpcds_q39/duckdb:parquet 32326888 31579200 1.02
tpcds_q40/duckdb:parquet 20108716 19740754 1.02
tpcds_q41/duckdb:parquet 9039299 8887604 1.02
tpcds_q42/duckdb:parquet 12136415 12706708 0.96
tpcds_q43/duckdb:parquet 17042789 18797786 0.91
tpcds_q44/duckdb:parquet 27211893 26377671 1.03
tpcds_q45/duckdb:parquet 29239893 30324267 0.96
tpcds_q46/duckdb:parquet 46927211 47728230 0.98
tpcds_q47/duckdb:parquet 50446463 49425799 1.02
tpcds_q48/duckdb:parquet 32522780 32261813 1.01
tpcds_q49/duckdb:parquet 28502528 29752721 0.96
tpcds_q50/duckdb:parquet 26487232 26445597 1.00
tpcds_q51/duckdb:parquet 106668017 104607251 1.02
tpcds_q52/duckdb:parquet 12513681 13801069 0.91
tpcds_q53/duckdb:parquet 19229088 19097925 1.01
tpcds_q54/duckdb:parquet 29501756 29706288 0.99
tpcds_q55/duckdb:parquet 12608091 12872101 0.98
tpcds_q56/duckdb:parquet 23934230 23824080 1.00
tpcds_q57/duckdb:parquet 39114438 37610901 1.04
tpcds_q58/duckdb:parquet 26304779 26009440 1.01
tpcds_q59/duckdb:parquet 36228391 36254734 1.00
tpcds_q60/duckdb:parquet 25053395 25101319 1.00
tpcds_q61/duckdb:parquet 34862552 34409729 1.01
tpcds_q62/duckdb:parquet 12477946 12670427 0.98
tpcds_q63/duckdb:parquet 17567019 17686415 0.99
tpcds_q64/duckdb:parquet 80574454 81484276 0.99
tpcds_q65/duckdb:parquet 22920587 22865766 1.00
tpcds_q66/duckdb:parquet 30223226 29246348 1.03
tpcds_q67/duckdb:parquet 136480861 137635090 0.99
tpcds_q68/duckdb:parquet 39173003 39890836 0.98
tpcds_q69/duckdb:parquet 39043760 39819834 0.98
tpcds_q70/duckdb:parquet 22767625 23462172 0.97
tpcds_q71/duckdb:parquet 23189817 23341460 0.99
tpcds_q72/duckdb:parquet 167083969 166965756 1.00
tpcds_q73/duckdb:parquet 20080317 20174298 1.00
tpcds_q74/duckdb:parquet 128686248 130428661 0.99
tpcds_q75/duckdb:parquet 58970493 58473186 1.01
tpcds_q76/duckdb:parquet 22383122 22296103 1.00
tpcds_q77/duckdb:parquet 25355104 25921723 0.98
tpcds_q78/duckdb:parquet 78856350 80778530 0.98
tpcds_q79/duckdb:parquet 30227578 30828460 0.98
tpcds_q80/duckdb:parquet 43036301 43623317 0.99
tpcds_q81/duckdb:parquet 35853163 36163547 0.99
tpcds_q82/duckdb:parquet 17061686 17593534 0.97
tpcds_q83/duckdb:parquet 18386964 19006251 0.97
tpcds_q84/duckdb:parquet 20490262 20970310 0.98
tpcds_q85/duckdb:parquet 41483399 43461509 0.95
tpcds_q86/duckdb:parquet 14220005 14317099 0.99
tpcds_q87/duckdb:parquet 39774035 40319758 0.99
tpcds_q88/duckdb:parquet 54456489 53800654 1.01
tpcds_q89/duckdb:parquet 21025061 22036984 0.95
tpcds_q90/duckdb:parquet 8370393 8817336 0.95
tpcds_q91/duckdb:parquet 25458948 26390584 0.96
tpcds_q92/duckdb:parquet 13169599 13783805 0.96
tpcds_q93/duckdb:parquet 32874919 33579373 0.98
tpcds_q94/duckdb:parquet 18188793 18569697 0.98
tpcds_q95/duckdb:parquet 121656356 125105140 0.97
tpcds_q96/duckdb:parquet 10333835 10748587 0.96
tpcds_q97/duckdb:parquet 40289409 38082803 1.06
tpcds_q98/duckdb:parquet 24045394 24747881 0.97
tpcds_q99/duckdb:parquet 20312634 20574594 0.99
duckdb / duckdb (1.006x ➖, 2↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22810337 23000172 0.99
tpcds_q02/duckdb:duckdb 19141352 20004683 0.96
tpcds_q03/duckdb:duckdb 10839247 10646148 1.02
tpcds_q04/duckdb:duckdb 174555500 180007104 0.97
tpcds_q05/duckdb:duckdb 22543155 20754894 1.09
tpcds_q06/duckdb:duckdb 28511327 28720869 0.99
tpcds_q07/duckdb:duckdb 40660048 41431815 0.98
tpcds_q08/duckdb:duckdb 120569479 120651412 1.00
tpcds_q09/duckdb:duckdb 21046197 20574279 1.02
tpcds_q10/duckdb:duckdb 27773486 27982065 0.99
tpcds_q11/duckdb:duckdb 95008149 91868531 1.03
tpcds_q12/duckdb:duckdb 14622517 14449896 1.01
tpcds_q13/duckdb:duckdb 26201228 26475456 0.99
tpcds_q14/duckdb:duckdb 94125225 93473294 1.01
tpcds_q15/duckdb:duckdb 25004160 25704023 0.97
tpcds_q16/duckdb:duckdb 19558023 21496341 0.91
tpcds_q17/duckdb:duckdb 26611601 24725804 1.08
tpcds_q18/duckdb:duckdb 48403380 48542661 1.00
tpcds_q19/duckdb:duckdb 19525319 19279048 1.01
tpcds_q20/duckdb:duckdb 14481677 14352175 1.01
tpcds_q21/duckdb:duckdb 🚀 7687098 9114476 0.84
tpcds_q22/duckdb:duckdb 62607341 64864548 0.97
tpcds_q23/duckdb:duckdb 78728283 78746404 1.00
tpcds_q24/duckdb:duckdb 25677692 25726924 1.00
tpcds_q25/duckdb:duckdb 19047316 19511901 0.98
tpcds_q26/duckdb:duckdb 28957499 28656653 1.01
tpcds_q27/duckdb:duckdb 41464080 42171894 0.98
tpcds_q28/duckdb:duckdb 27019907 25155066 1.07
tpcds_q29/duckdb:duckdb 24445834 23476321 1.04
tpcds_q30/duckdb:duckdb 31330041 31408223 1.00
tpcds_q31/duckdb:duckdb 51599914 52215023 0.99
tpcds_q32/duckdb:duckdb 8500034 8384091 1.01
tpcds_q33/duckdb:duckdb 16810071 16466385 1.02
tpcds_q34/duckdb:duckdb 19073516 18355642 1.04
tpcds_q35/duckdb:duckdb 35973730 37642124 0.96
tpcds_q36/duckdb:duckdb 71589631 72395890 0.99
tpcds_q37/duckdb:duckdb 8848532 8868716 1.00
tpcds_q38/duckdb:duckdb 33397239 34332986 0.97
tpcds_q39/duckdb:duckdb 28500972 28167092 1.01
tpcds_q40/duckdb:duckdb 15032839 14890181 1.01
tpcds_q41/duckdb:duckdb 9777381 9444501 1.04
tpcds_q42/duckdb:duckdb 🚨 9677540 8565190 1.13
tpcds_q43/duckdb:duckdb 14977295 15282191 0.98
tpcds_q44/duckdb:duckdb 16197293 15728643 1.03
tpcds_q45/duckdb:duckdb 19601548 18762242 1.04
tpcds_q46/duckdb:duckdb 38770623 38429484 1.01
tpcds_q47/duckdb:duckdb 46271135 45853720 1.01
tpcds_q48/duckdb:duckdb 25083181 25772879 0.97
tpcds_q49/duckdb:duckdb 22205412 20309397 1.09
tpcds_q50/duckdb:duckdb 16353925 16010386 1.02
tpcds_q51/duckdb:duckdb 101431812 98978829 1.02
tpcds_q52/duckdb:duckdb 9849106 10626740 0.93
tpcds_q53/duckdb:duckdb 18003942 18339223 0.98
tpcds_q54/duckdb:duckdb 18778674 19711628 0.95
tpcds_q55/duckdb:duckdb 🚀 9257942 10381599 0.89
tpcds_q56/duckdb:duckdb 16823199 16297975 1.03
tpcds_q57/duckdb:duckdb 36321932 36495277 1.00
tpcds_q58/duckdb:duckdb 16949963 17076328 0.99
tpcds_q59/duckdb:duckdb 36874288 36874558 1.00
tpcds_q60/duckdb:duckdb 19288894 18738363 1.03
tpcds_q61/duckdb:duckdb 16741248 16441977 1.02
tpcds_q62/duckdb:duckdb 10030922 10000355 1.00
tpcds_q63/duckdb:duckdb 16348365 16341909 1.00
tpcds_q64/duckdb:duckdb 59388139 59660361 1.00
tpcds_q65/duckdb:duckdb 36902220 37113603 0.99
tpcds_q66/duckdb:duckdb 26915547 26709915 1.01
tpcds_q67/duckdb:duckdb 129475351 133728729 0.97
tpcds_q68/duckdb:duckdb 27058902 27545668 0.98
tpcds_q69/duckdb:duckdb 28347601 28093670 1.01
tpcds_q70/duckdb:duckdb 16981355 16678483 1.02
tpcds_q71/duckdb:duckdb 16771361 15906532 1.05
tpcds_q72/duckdb:duckdb 46396949 46176600 1.00
tpcds_q73/duckdb:duckdb 14680218 14034289 1.05
tpcds_q74/duckdb:duckdb 146210528 146394077 1.00
tpcds_q75/duckdb:duckdb 46155116 46348760 1.00
tpcds_q76/duckdb:duckdb 15784255 14866716 1.06
tpcds_q77/duckdb:duckdb 15904099 14994670 1.06
tpcds_q78/duckdb:duckdb 65810747 65694381 1.00
tpcds_q79/duckdb:duckdb 20192921 20199468 1.00
tpcds_q80/duckdb:duckdb 32987749 31018622 1.06
tpcds_q81/duckdb:duckdb 40347808 41316821 0.98
tpcds_q82/duckdb:duckdb 10069619 10236734 0.98
tpcds_q83/duckdb:duckdb 10955127 11324092 0.97
tpcds_q84/duckdb:duckdb 15018209 14976944 1.00
tpcds_q85/duckdb:duckdb 25316494 25844280 0.98
tpcds_q86/duckdb:duckdb 12094957 12057544 1.00
tpcds_q87/duckdb:duckdb 36594582 36041937 1.02
tpcds_q88/duckdb:duckdb 30395694 28724312 1.06
tpcds_q89/duckdb:duckdb 22710807 21554216 1.05
tpcds_q90/duckdb:duckdb 6460233 6292458 1.03
tpcds_q91/duckdb:duckdb 14835955 14189266 1.05
tpcds_q92/duckdb:duckdb 10184936 9884596 1.03
tpcds_q93/duckdb:duckdb 23786835 24063061 0.99
tpcds_q94/duckdb:duckdb 14482856 14938360 0.97
tpcds_q95/duckdb:duckdb 🚨 135034937 113522764 1.19
tpcds_q96/duckdb:duckdb 5972132 5966132 1.00
tpcds_q97/duckdb:duckdb 32396914 32687358 0.99
tpcds_q98/duckdb:duckdb 21038245 21048156 1.00
tpcds_q99/duckdb:duckdb 17215837 16927645 1.02
File Size Changes (7 files changed, -0.0% overall, 4↑ 3↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 376.04 KB 381.24 KB +5.20 KB +1.4%
catalog_page.vortex 1.0 vortex-file-compressed 571.47 KB 572.25 KB +800 B +0.1%
customer_address.vortex 1.0 vortex-file-compressed 824.85 KB 825.80 KB +976 B +0.1%
item.vortex 1.0 vortex-compact 994.25 KB 994.50 KB +256 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 3.66 KB -0.2%
customer.vortex 1.0 vortex-file-compressed 4.26 MB 4.18 MB 88.48 KB -2.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 963.59 KB 91.80 KB -8.7%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.84 MB → 271.67 MB (-0.1%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+3.7%, environment too noisy confidence)
Vortex (geomean): 1.108x ➖
Parquet (geomean): 1.080x ➖
Shifts: Parquet (control) +8.0% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.134x ➖, 0↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 45603212 37148326 1.23
fineweb_q01/datafusion:vortex-file-compressed 🚨 826325200 459513253 1.80
fineweb_q02/datafusion:vortex-file-compressed 483056575 462920684 1.04
fineweb_q03/datafusion:vortex-file-compressed 1252110472 1083353797 1.16
fineweb_q04/datafusion:vortex-file-compressed 1158791884 1137208846 1.02
fineweb_q05/datafusion:vortex-file-compressed 1099735933 1074657447 1.02
fineweb_q06/datafusion:vortex-file-compressed 1253422677 1185017837 1.06
fineweb_q07/datafusion:vortex-file-compressed 1117572213 1097478196 1.02
fineweb_q08/datafusion:vortex-file-compressed 463488962 446097186 1.04
datafusion / vortex-compact (1.085x ➖, 0↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 42281377 27887744 1.52
fineweb_q01/datafusion:vortex-compact 🚨 640591291 454124513 1.41
fineweb_q02/datafusion:vortex-compact 556921575 588156395 0.95
fineweb_q03/datafusion:vortex-compact 1363413916 1388387239 0.98
fineweb_q04/datafusion:vortex-compact 1578925380 1577195610 1.00
fineweb_q05/datafusion:vortex-compact 1415489183 1381049924 1.02
fineweb_q06/datafusion:vortex-compact 1371037721 1330805257 1.03
fineweb_q07/datafusion:vortex-compact 1128715803 1190060785 0.95
fineweb_q08/datafusion:vortex-compact 395615724 377943351 1.05
datafusion / parquet (1.093x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1183576024 1029973049 1.15
fineweb_q01/datafusion:parquet 1866007596 1710987829 1.09
fineweb_q02/datafusion:parquet 1991605548 1773401901 1.12
fineweb_q03/datafusion:parquet 1977350760 1819060318 1.09
fineweb_q04/datafusion:parquet 1972001094 1848619998 1.07
fineweb_q05/datafusion:parquet 2057561006 1951058646 1.05
fineweb_q06/datafusion:parquet 1936929201 1873819837 1.03
fineweb_q07/datafusion:parquet 1911894604 1748880730 1.09
fineweb_q08/datafusion:parquet 2002735535 1753121908 1.14
duckdb / vortex-file-compressed (1.135x ➖, 0↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 86577452 80865539 1.07
fineweb_q01/duckdb:vortex-file-compressed 672985907 529891896 1.27
fineweb_q02/duckdb:vortex-file-compressed 🚨 560837579 421087998 1.33
fineweb_q03/duckdb:vortex-file-compressed 1371441097 1314569739 1.04
fineweb_q04/duckdb:vortex-file-compressed 1671927199 1401758487 1.19
fineweb_q05/duckdb:vortex-file-compressed 1388524357 1202518527 1.15
fineweb_q06/duckdb:vortex-file-compressed 1541466859 1415145646 1.09
fineweb_q07/duckdb:vortex-file-compressed 1322385891 1223253789 1.08
fineweb_q08/duckdb:vortex-file-compressed 548361638 537516965 1.02
duckdb / vortex-compact (1.080x ➖, 0↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 83741361 84221982 0.99
fineweb_q01/duckdb:vortex-compact 🚨 769848491 534947261 1.44
fineweb_q02/duckdb:vortex-compact 580183973 580829601 1.00
fineweb_q03/duckdb:vortex-compact 1756499362 1770376902 0.99
fineweb_q04/duckdb:vortex-compact 1900968788 1884290929 1.01
fineweb_q05/duckdb:vortex-compact 1660966785 1585216219 1.05
fineweb_q06/duckdb:vortex-compact 1624960672 1544456511 1.05
fineweb_q07/duckdb:vortex-compact 1418011834 1325749902 1.07
fineweb_q08/duckdb:vortex-compact 551811162 464867651 1.19
duckdb / parquet (1.068x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1280591705 1191478316 1.07
fineweb_q01/duckdb:parquet 1590549211 1347436709 1.18
fineweb_q02/duckdb:parquet 1542642476 1332976643 1.16
fineweb_q03/duckdb:parquet 3918391789 3540343737 1.11
fineweb_q04/duckdb:parquet 2061303369 2028257829 1.02
fineweb_q05/duckdb:parquet 2333766600 2150220434 1.09
fineweb_q06/duckdb:parquet 4633409508 4273123125 1.08
fineweb_q07/duckdb:parquet 2683246460 2673431091 1.00
fineweb_q08/duckdb:parquet 1114727793 1202296485 0.93

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DuckDB No clear signal (+2.0%, low confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11899359 12380608 0.96
statpopgen_q01/duckdb:vortex-file-compressed 26265468 27448089 0.96
statpopgen_q02/duckdb:vortex-file-compressed 530889430 548104271 0.97
statpopgen_q03/duckdb:vortex-file-compressed 1053943701 1076919478 0.98
statpopgen_q04/duckdb:vortex-file-compressed 1071486390 1069577556 1.00
statpopgen_q05/duckdb:vortex-file-compressed 485799494 528705376 0.92
statpopgen_q06/duckdb:vortex-file-compressed 1539211099 1560869212 0.99
statpopgen_q07/duckdb:vortex-file-compressed 205033655 202563595 1.01
statpopgen_q08/duckdb:vortex-file-compressed 246362502 241904976 1.02
statpopgen_q09/duckdb:vortex-file-compressed 848374861 829756511 1.02
statpopgen_q10/duckdb:vortex-file-compressed 2579036598 2579998984 1.00
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12120493 12209329 0.99
statpopgen_q01/duckdb:vortex-compact 219005007 216015885 1.01
statpopgen_q02/duckdb:vortex-compact 567277868 571155309 0.99
statpopgen_q03/duckdb:vortex-compact 1158258886 1164946129 0.99
statpopgen_q04/duckdb:vortex-compact 1164676561 1178230928 0.99
statpopgen_q05/duckdb:vortex-compact 581281201 588039033 0.99
statpopgen_q06/duckdb:vortex-compact 1517290670 1508055799 1.01
statpopgen_q07/duckdb:vortex-compact 897132943 921585029 0.97
statpopgen_q08/duckdb:vortex-compact 937754013 937655937 1.00
statpopgen_q09/duckdb:vortex-compact 926345127 923178546 1.00
statpopgen_q10/duckdb:vortex-compact 2613198258 2616220020 1.00
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 306095655 312733412 0.98
statpopgen_q01/duckdb:parquet 390609374 397944877 0.98
statpopgen_q02/duckdb:parquet 768746610 799640805 0.96
statpopgen_q03/duckdb:parquet 1194326883 1260073042 0.95
statpopgen_q04/duckdb:parquet 1190199214 1268023911 0.94
statpopgen_q05/duckdb:parquet 819917314 855332826 0.96
statpopgen_q06/duckdb:parquet 1424736492 1511693031 0.94
statpopgen_q07/duckdb:parquet 871191812 881680193 0.99
statpopgen_q08/duckdb:parquet 878675405 869284224 1.01
statpopgen_q09/duckdb:parquet 1031970742 1041693580 0.99
statpopgen_q10/duckdb:parquet 2214146134 2270488804 0.98
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 5.71 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.974x ➖
Shifts: Parquet (control) -2.6% · Median polish -2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.953x ➖, 6↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 404453115 414166505 0.98
tpch_q02/datafusion:vortex-file-compressed 116135189 114012849 1.02
tpch_q03/datafusion:vortex-file-compressed 222858292 216976341 1.03
tpch_q04/datafusion:vortex-file-compressed 119457875 114950947 1.04
tpch_q05/datafusion:vortex-file-compressed 392831020 394112890 1.00
tpch_q06/datafusion:vortex-file-compressed 39345016 38626294 1.02
tpch_q07/datafusion:vortex-file-compressed 524602066 517065875 1.01
tpch_q08/datafusion:vortex-file-compressed 383760272 378415908 1.01
tpch_q09/datafusion:vortex-file-compressed 678863604 664613397 1.02
tpch_q10/datafusion:vortex-file-compressed 242237264 244308928 0.99
tpch_q11/datafusion:vortex-file-compressed 🚀 87656135 98234212 0.89
tpch_q12/datafusion:vortex-file-compressed 🚀 122935546 138174703 0.89
tpch_q13/datafusion:vortex-file-compressed 227857421 252751212 0.90
tpch_q14/datafusion:vortex-file-compressed 54943719 59412253 0.92
tpch_q15/datafusion:vortex-file-compressed 🚀 103328415 114901774 0.90
tpch_q16/datafusion:vortex-file-compressed 78881918 87173941 0.90
tpch_q17/datafusion:vortex-file-compressed 🚀 671839957 746797851 0.90
tpch_q18/datafusion:vortex-file-compressed 902900762 1002216827 0.90
tpch_q19/datafusion:vortex-file-compressed 🚀 80317601 92395012 0.87
tpch_q20/datafusion:vortex-file-compressed 171043978 189046123 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 700050874 781824725 0.90
tpch_q22/datafusion:vortex-file-compressed 69661930 69313172 1.01
datafusion / vortex-compact (0.968x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 459162892 458084712 1.00
tpch_q02/datafusion:vortex-compact 120811110 121210093 1.00
tpch_q03/datafusion:vortex-compact 225515686 226353413 1.00
tpch_q04/datafusion:vortex-compact 122168249 128416218 0.95
tpch_q05/datafusion:vortex-compact 391905647 409943455 0.96
tpch_q06/datafusion:vortex-compact 61745099 63248545 0.98
tpch_q07/datafusion:vortex-compact 541623599 556275518 0.97
tpch_q08/datafusion:vortex-compact 387363476 399011227 0.97
tpch_q09/datafusion:vortex-compact 679561917 692596450 0.98
tpch_q10/datafusion:vortex-compact 259809918 253951967 1.02
tpch_q11/datafusion:vortex-compact 90824675 88534311 1.03
tpch_q12/datafusion:vortex-compact 164775561 174518107 0.94
tpch_q13/datafusion:vortex-compact 278820612 302967195 0.92
tpch_q14/datafusion:vortex-compact 72187714 77223385 0.93
tpch_q15/datafusion:vortex-compact 160599156 176465655 0.91
tpch_q16/datafusion:vortex-compact 84944298 91768611 0.93
tpch_q17/datafusion:vortex-compact 672589854 737915187 0.91
tpch_q18/datafusion:vortex-compact 898938937 971584065 0.93
tpch_q19/datafusion:vortex-compact 126514762 134640487 0.94
tpch_q20/datafusion:vortex-compact 196270615 187919334 1.04
tpch_q21/datafusion:vortex-compact 705632203 703779949 1.00
tpch_q22/datafusion:vortex-compact 75450278 75268939 1.00
datafusion / parquet (0.976x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 471410894 448616311 1.05
tpch_q02/datafusion:parquet 182611141 175895874 1.04
tpch_q03/datafusion:parquet 292817570 287840383 1.02
tpch_q04/datafusion:parquet 133596153 130408162 1.02
tpch_q05/datafusion:parquet 453641284 438778419 1.03
tpch_q06/datafusion:parquet 129991722 124763222 1.04
tpch_q07/datafusion:parquet 630847772 606718361 1.04
tpch_q08/datafusion:parquet 484885322 469348612 1.03
tpch_q09/datafusion:parquet 779556463 837236810 0.93
tpch_q10/datafusion:parquet 524512101 558564822 0.94
tpch_q11/datafusion:parquet 125131039 133977743 0.93
tpch_q12/datafusion:parquet 203598540 215159366 0.95
tpch_q13/datafusion:parquet 341204013 362420370 0.94
tpch_q14/datafusion:parquet 163500054 177572550 0.92
tpch_q15/datafusion:parquet 260861962 274700456 0.95
tpch_q16/datafusion:parquet 127378456 137425704 0.93
tpch_q17/datafusion:parquet 717281934 783184852 0.92
tpch_q18/datafusion:parquet 946630803 1036719385 0.91
tpch_q19/datafusion:parquet 266663067 284201341 0.94
tpch_q20/datafusion:parquet 307778772 326365571 0.94
tpch_q21/datafusion:parquet 729088996 708500840 1.03
tpch_q22/datafusion:parquet 216427364 219694413 0.99
datafusion / arrow (1.001x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 621032548 630241800 0.99
tpch_q02/datafusion:arrow 174952707 178949897 0.98
tpch_q03/datafusion:arrow 494747601 507099779 0.98
tpch_q04/datafusion:arrow 366886590 370808808 0.99
tpch_q05/datafusion:arrow 976804435 1074238237 0.91
tpch_q06/datafusion:arrow 293165874 312890446 0.94
tpch_q07/datafusion:arrow 1226575843 1232723312 1.00
tpch_q08/datafusion:arrow 1194867325 1170441468 1.02
tpch_q09/datafusion:arrow 1408645436 1376898010 1.02
tpch_q10/datafusion:arrow 618942865 599154876 1.03
tpch_q11/datafusion:arrow 144251873 143838804 1.00
tpch_q12/datafusion:arrow 795410022 793915443 1.00
tpch_q13/datafusion:arrow 508852143 515088464 0.99
tpch_q14/datafusion:arrow 334611496 325961714 1.03
tpch_q15/datafusion:arrow 743123501 708206738 1.05
tpch_q16/datafusion:arrow 110484346 109366661 1.01
tpch_q17/datafusion:arrow 1391220049 1394163047 1.00
tpch_q18/datafusion:arrow 2023090296 1981305140 1.02
tpch_q19/datafusion:arrow 505060716 501710823 1.01
tpch_q20/datafusion:arrow 518766887 505970257 1.03
tpch_q21/datafusion:arrow 3114451923 2988933200 1.04
tpch_q22/datafusion:arrow 136487000 135148760 1.01
duckdb / vortex-file-compressed (0.984x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170552739 178630695 0.95
tpch_q02/duckdb:vortex-file-compressed 52866316 55188805 0.96
tpch_q03/duckdb:vortex-file-compressed 125718838 135195658 0.93
tpch_q04/duckdb:vortex-file-compressed 163347516 170015433 0.96
tpch_q05/duckdb:vortex-file-compressed 140471311 144298366 0.97
tpch_q06/duckdb:vortex-file-compressed 35093475 34628370 1.01
tpch_q07/duckdb:vortex-file-compressed 135199212 137055191 0.99
tpch_q08/duckdb:vortex-file-compressed 172847285 168872919 1.02
tpch_q09/duckdb:vortex-file-compressed 401826840 406032398 0.99
tpch_q10/duckdb:vortex-file-compressed 199170553 198221575 1.00
tpch_q11/duckdb:vortex-file-compressed 33352753 32143552 1.04
tpch_q12/duckdb:vortex-file-compressed 102816233 100834469 1.02
tpch_q13/duckdb:vortex-file-compressed 278170523 285766919 0.97
tpch_q14/duckdb:vortex-file-compressed 53772871 53138465 1.01
tpch_q15/duckdb:vortex-file-compressed 91241488 89186993 1.02
tpch_q16/duckdb:vortex-file-compressed 81160504 77046730 1.05
tpch_q17/duckdb:vortex-file-compressed 96509755 97009303 0.99
tpch_q18/duckdb:vortex-file-compressed 🚀 292508786 410499799 0.71
tpch_q19/duckdb:vortex-file-compressed 80332795 79870790 1.01
tpch_q20/duckdb:vortex-file-compressed 144735961 141808163 1.02
tpch_q21/duckdb:vortex-file-compressed 502774108 488094466 1.03
tpch_q22/duckdb:vortex-file-compressed 67043574 65616479 1.02
duckdb / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231975705 233175648 0.99
tpch_q02/duckdb:vortex-compact 58412292 58863407 0.99
tpch_q03/duckdb:vortex-compact 138036507 142703449 0.97
tpch_q04/duckdb:vortex-compact 174250412 181662540 0.96
tpch_q05/duckdb:vortex-compact 169773622 167356571 1.01
tpch_q06/duckdb:vortex-compact 58436490 60390283 0.97
tpch_q07/duckdb:vortex-compact 176972547 176685482 1.00
tpch_q08/duckdb:vortex-compact 192332488 195144383 0.99
tpch_q09/duckdb:vortex-compact 436866326 437309959 1.00
tpch_q10/duckdb:vortex-compact 226438811 224138823 1.01
tpch_q11/duckdb:vortex-compact 39458073 39845458 0.99
tpch_q12/duckdb:vortex-compact 164459904 165698235 0.99
tpch_q13/duckdb:vortex-compact 330170517 332315505 0.99
tpch_q14/duckdb:vortex-compact 73831705 74064377 1.00
tpch_q15/duckdb:vortex-compact 116997359 115420368 1.01
tpch_q16/duckdb:vortex-compact 82599693 78396531 1.05
tpch_q17/duckdb:vortex-compact 110216418 113698455 0.97
tpch_q18/duckdb:vortex-compact 291941828 306846588 0.95
tpch_q19/duckdb:vortex-compact 98508046 102854173 0.96
tpch_q20/duckdb:vortex-compact 183539756 191580042 0.96
tpch_q21/duckdb:vortex-compact 531556257 575042624 0.92
tpch_q22/duckdb:vortex-compact 72802298 77236662 0.94
duckdb / parquet (0.973x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265256225 273991179 0.97
tpch_q02/duckdb:parquet 104392022 104870084 1.00
tpch_q03/duckdb:parquet 217096318 220234753 0.99
tpch_q04/duckdb:parquet 137803984 145692664 0.95
tpch_q05/duckdb:parquet 225354258 235944224 0.96
tpch_q06/duckdb:parquet 74258201 77596135 0.96
tpch_q07/duckdb:parquet 191223008 196358945 0.97
tpch_q08/duckdb:parquet 266581192 284501809 0.94
tpch_q09/duckdb:parquet 480751687 494821381 0.97
tpch_q10/duckdb:parquet 628499548 639062817 0.98
tpch_q11/duckdb:parquet 69675391 66159337 1.05
tpch_q12/duckdb:parquet 131770215 135858076 0.97
tpch_q13/duckdb:parquet 420225989 431535439 0.97
tpch_q14/duckdb:parquet 181417859 187607860 0.97
tpch_q15/duckdb:parquet 105076884 109523249 0.96
tpch_q16/duckdb:parquet 166913179 165476901 1.01
tpch_q17/duckdb:parquet 181339292 182802653 0.99
tpch_q18/duckdb:parquet 363291291 370607929 0.98
tpch_q19/duckdb:parquet 291093634 295345133 0.99
tpch_q20/duckdb:parquet 231723207 242280999 0.96
tpch_q21/duckdb:parquet 573528943 621726057 0.92
tpch_q22/duckdb:parquet 294512096 304647214 0.97
duckdb / duckdb (0.961x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120684678 123496930 0.98
tpch_q02/duckdb:duckdb 49503082 52007241 0.95
tpch_q03/duckdb:duckdb 105084362 111212204 0.94
tpch_q04/duckdb:duckdb 141413272 153971163 0.92
tpch_q05/duckdb:duckdb 120973811 131104881 0.92
tpch_q06/duckdb:duckdb 45010491 46713867 0.96
tpch_q07/duckdb:duckdb 92372846 96157356 0.96
tpch_q08/duckdb:duckdb 120207931 129293584 0.93
tpch_q09/duckdb:duckdb 284756803 298292580 0.95
tpch_q10/duckdb:duckdb 218047774 214685346 1.02
tpch_q11/duckdb:duckdb 19548323 19021971 1.03
tpch_q12/duckdb:duckdb 91465674 89693969 1.02
tpch_q13/duckdb:duckdb 234005311 247931662 0.94
tpch_q14/duckdb:duckdb 78862380 83031946 0.95
tpch_q15/duckdb:duckdb 84180559 86249527 0.98
tpch_q16/duckdb:duckdb 77416196 84752498 0.91
tpch_q17/duckdb:duckdb 88494217 90754940 0.98
tpch_q18/duckdb:duckdb 239350213 248711915 0.96
tpch_q19/duckdb:duckdb 125729622 130165431 0.97
tpch_q20/duckdb:duckdb 119021087 123128067 0.97
tpch_q21/duckdb:duckdb 308290876 335812201 0.92
tpch_q22/duckdb:duckdb 71773765 71973180 1.00
File Size Changes (27 files changed, +0.0% overall, 14↑ 13↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.70 MB 5.76 MB +65.19 KB +1.1%
part_1.vortex 10.0 vortex-file-compressed 24.73 MB 24.88 MB +156.38 KB +0.6%
partsupp_1.vortex 10.0 vortex-compact 104.87 MB 105.30 MB +441.74 KB +0.4%
partsupp_0.vortex 10.0 vortex-compact 104.43 MB 104.53 MB +107.71 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.08 MB 134.19 MB +108.07 KB +0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.29 MB 134.39 MB +105.06 KB +0.1%
partsupp_0.vortex 10.0 vortex-file-compressed 120.30 MB 120.37 MB +79.70 KB +0.1%
partsupp_1.vortex 10.0 vortex-file-compressed 120.28 MB 120.33 MB +56.31 KB +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.08 MB 134.13 MB +55.01 KB +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 133.54 MB 133.59 MB +52.28 KB +0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 133.95 MB 134.00 MB +50.52 KB +0.0%
orders_1.vortex 10.0 vortex-file-compressed 145.73 MB 145.78 MB +49.98 KB +0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.11 MB 134.14 MB +28.16 KB +0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 133.78 MB 133.78 MB +3.27 KB +0.0%
part_0.vortex 10.0 vortex-compact 17.12 MB 17.12 MB 2.28 KB -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.22 MB 133.19 MB 33.80 KB -0.0%
orders_2.vortex 10.0 vortex-file-compressed 145.71 MB 145.66 MB 44.70 KB -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.09 MB 25.56 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.59 MB 133.55 MB 48.36 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.21 MB 134.15 MB 64.35 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.87 MB 132.80 MB 72.47 KB -0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.53 MB 88.47 MB 53.72 KB -0.1%
part_0.vortex 10.0 vortex-file-compressed 24.79 MB 24.78 MB 16.73 KB -0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.20 MB 134.10 MB 99.31 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.60 MB 133.50 MB 100.24 KB -0.1%
orders_0.vortex 10.0 vortex-file-compressed 144.56 MB 144.21 MB 358.08 KB -0.2%
part_1.vortex 10.0 vortex-compact 17.08 MB 16.95 MB 135.41 KB -0.8%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+2.2%, low confidence) · DuckDB No clear signal (-3.5%, environment too noisy confidence)
Vortex (geomean): 1.048x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.024x ➖, 1↑ 5↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1603458 1681834 0.95
clickbench_q01/datafusion:vortex-file-compressed 16662697 16778404 0.99
clickbench_q02/datafusion:vortex-file-compressed 34619389 35993952 0.96
clickbench_q03/datafusion:vortex-file-compressed 40591964 41546669 0.98
clickbench_q04/datafusion:vortex-file-compressed 277624826 280617208 0.99
clickbench_q05/datafusion:vortex-file-compressed 324754374 323870507 1.00
clickbench_q06/datafusion:vortex-file-compressed 🚀 1662765 1949158 0.85
clickbench_q07/datafusion:vortex-file-compressed 🚨 23528892 19980426 1.18
clickbench_q08/datafusion:vortex-file-compressed 343587214 342959153 1.00
clickbench_q09/datafusion:vortex-file-compressed 562917377 551087746 1.02
clickbench_q10/datafusion:vortex-file-compressed 73455040 74055968 0.99
clickbench_q11/datafusion:vortex-file-compressed 84553137 86505896 0.98
clickbench_q12/datafusion:vortex-file-compressed 290108294 290451717 1.00
clickbench_q13/datafusion:vortex-file-compressed 429105443 430009490 1.00
clickbench_q14/datafusion:vortex-file-compressed 264205999 274735211 0.96
clickbench_q15/datafusion:vortex-file-compressed 326109611 319052454 1.02
clickbench_q16/datafusion:vortex-file-compressed 659465993 672292690 0.98
clickbench_q17/datafusion:vortex-file-compressed 662113621 646993024 1.02
clickbench_q18/datafusion:vortex-file-compressed 1331271053 1363508873 0.98
clickbench_q19/datafusion:vortex-file-compressed 🚨 37524285 32820305 1.14
clickbench_q20/datafusion:vortex-file-compressed 327543153 324049210 1.01
clickbench_q21/datafusion:vortex-file-compressed 412419252 416126363 0.99
clickbench_q22/datafusion:vortex-file-compressed 520094036 513332142 1.01
clickbench_q23/datafusion:vortex-file-compressed 544044466 552612163 0.98
clickbench_q24/datafusion:vortex-file-compressed 53973577 49620502 1.09
clickbench_q25/datafusion:vortex-file-compressed 79532341 79296754 1.00
clickbench_q26/datafusion:vortex-file-compressed 47487538 49734285 0.95
clickbench_q27/datafusion:vortex-file-compressed 783960104 760316320 1.03
clickbench_q28/datafusion:vortex-file-compressed 5917968092 5754789595 1.03
clickbench_q29/datafusion:vortex-file-compressed 216047620 219294187 0.99
clickbench_q30/datafusion:vortex-file-compressed 251531244 246415019 1.02
clickbench_q31/datafusion:vortex-file-compressed 294831524 289197441 1.02
clickbench_q32/datafusion:vortex-file-compressed 1151387013 1115061751 1.03
clickbench_q33/datafusion:vortex-file-compressed 1393821436 1361338156 1.02
clickbench_q34/datafusion:vortex-file-compressed 1418610916 1362406030 1.04
clickbench_q35/datafusion:vortex-file-compressed 482373648 439049630 1.10
clickbench_q36/datafusion:vortex-file-compressed 80051448 75384329 1.06
clickbench_q37/datafusion:vortex-file-compressed 🚨 41147466 34734235 1.18
clickbench_q38/datafusion:vortex-file-compressed 21492242 19984875 1.08
clickbench_q39/datafusion:vortex-file-compressed 148426099 136729149 1.09
clickbench_q40/datafusion:vortex-file-compressed 17042314 15922875 1.07
clickbench_q41/datafusion:vortex-file-compressed 🚨 17296641 14881075 1.16
clickbench_q42/datafusion:vortex-file-compressed 🚨 18913392 16640556 1.14
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1537842 1539829 1.00
clickbench_q01/datafusion:parquet 19353346 20310223 0.95
clickbench_q02/datafusion:parquet 48566626 47535564 1.02
clickbench_q03/datafusion:parquet 37582753 39067063 0.96
clickbench_q04/datafusion:parquet 300977653 304008426 0.99
clickbench_q05/datafusion:parquet 360559064 342829041 1.05
clickbench_q06/datafusion:parquet 1542058 1565962 0.98
clickbench_q07/datafusion:parquet 22212796 22344821 0.99
clickbench_q08/datafusion:parquet 369174424 365018105 1.01
clickbench_q09/datafusion:parquet 607253168 619346480 0.98
clickbench_q10/datafusion:parquet 104174161 106196820 0.98
clickbench_q11/datafusion:parquet 131271004 131078750 1.00
clickbench_q12/datafusion:parquet 347874305 341857983 1.02
clickbench_q13/datafusion:parquet 511069624 502929378 1.02
clickbench_q14/datafusion:parquet 343715440 340860138 1.01
clickbench_q15/datafusion:parquet 343246649 338327932 1.01
clickbench_q16/datafusion:parquet 667259887 665751739 1.00
clickbench_q17/datafusion:parquet 646186446 649607212 0.99
clickbench_q18/datafusion:parquet 1371365049 1407594474 0.97
clickbench_q19/datafusion:parquet 30391592 30850189 0.99
clickbench_q20/datafusion:parquet 606992305 592268489 1.02
clickbench_q21/datafusion:parquet 660000055 655530965 1.01
clickbench_q22/datafusion:parquet 980135175 966424402 1.01
clickbench_q23/datafusion:parquet 3718882233 3655149337 1.02
clickbench_q24/datafusion:parquet 81966217 81134430 1.01
clickbench_q25/datafusion:parquet 129478902 132619431 0.98
clickbench_q26/datafusion:parquet 81907135 81358921 1.01
clickbench_q27/datafusion:parquet 1043970291 1071403143 0.97
clickbench_q28/datafusion:parquet 6531208453 6557233919 1.00
clickbench_q29/datafusion:parquet 244418701 233152538 1.05
clickbench_q30/datafusion:parquet 329267794 326854785 1.01
clickbench_q31/datafusion:parquet 373618676 366718087 1.02
clickbench_q32/datafusion:parquet 1235692528 1188705676 1.04
clickbench_q33/datafusion:parquet 1486283600 1474415475 1.01
clickbench_q34/datafusion:parquet 1484372131 1528251823 0.97
clickbench_q35/datafusion:parquet 461813156 472457661 0.98
clickbench_q36/datafusion:parquet 145199405 146507014 0.99
clickbench_q37/datafusion:parquet 57758161 57706482 1.00
clickbench_q38/datafusion:parquet 85836972 87862263 0.98
clickbench_q39/datafusion:parquet 270004392 264985362 1.02
clickbench_q40/datafusion:parquet 30459606 30167572 1.01
clickbench_q41/datafusion:parquet 27091155 26651787 1.02
clickbench_q42/datafusion:parquet 30396294 29392002 1.03
duckdb / vortex-file-compressed (1.072x ➖, 1↑ 16↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7519551 6224289 1.21
clickbench_q01/duckdb:vortex-file-compressed 🚨 12790259 10781983 1.19
clickbench_q02/duckdb:vortex-file-compressed 27606500 26302495 1.05
clickbench_q03/duckdb:vortex-file-compressed 31554001 30920728 1.02
clickbench_q04/duckdb:vortex-file-compressed 204862727 186456352 1.10
clickbench_q05/duckdb:vortex-file-compressed 🚨 207392602 180263490 1.15
clickbench_q06/duckdb:vortex-file-compressed 🚨 22906597 20206473 1.13
clickbench_q07/duckdb:vortex-file-compressed 🚨 16099463 14325665 1.12
clickbench_q08/duckdb:vortex-file-compressed 🚨 307440453 264650815 1.16
clickbench_q09/duckdb:vortex-file-compressed 🚨 385911687 337467547 1.14
clickbench_q10/duckdb:vortex-file-compressed 🚨 77866521 67927788 1.15
clickbench_q11/duckdb:vortex-file-compressed 🚨 93107417 77250571 1.21
clickbench_q12/duckdb:vortex-file-compressed 🚨 239812278 200716591 1.19
clickbench_q13/duckdb:vortex-file-compressed 🚨 487196381 406706394 1.20
clickbench_q14/duckdb:vortex-file-compressed 🚨 282000165 235524786 1.20
clickbench_q15/duckdb:vortex-file-compressed 🚨 280922393 243325346 1.15
clickbench_q16/duckdb:vortex-file-compressed 🚨 648551162 523320457 1.24
clickbench_q17/duckdb:vortex-file-compressed 468452174 426099301 1.10
clickbench_q18/duckdb:vortex-file-compressed 975580982 940999270 1.04
clickbench_q19/duckdb:vortex-file-compressed 22344536 21370171 1.05
clickbench_q20/duckdb:vortex-file-compressed 318316263 317431332 1.00
clickbench_q21/duckdb:vortex-file-compressed 399243106 399511940 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 704839433 570814307 1.23
clickbench_q23/duckdb:vortex-file-compressed 🚨 203313685 179844311 1.13
clickbench_q24/duckdb:vortex-file-compressed 44528679 43768475 1.02
clickbench_q25/duckdb:vortex-file-compressed 🚀 74349464 83671862 0.89
clickbench_q26/duckdb:vortex-file-compressed 48418290 46609894 1.04
clickbench_q27/duckdb:vortex-file-compressed 517881949 521615068 0.99
clickbench_q28/duckdb:vortex-file-compressed 3059809766 3071105374 1.00
clickbench_q29/duckdb:vortex-file-compressed 29473830 29624042 0.99
clickbench_q30/duckdb:vortex-file-compressed 212392172 210237243 1.01
clickbench_q31/duckdb:vortex-file-compressed 307651201 311168317 0.99
clickbench_q32/duckdb:vortex-file-compressed 1131128407 1123197888 1.01
clickbench_q33/duckdb:vortex-file-compressed 1118983088 1113344771 1.01
clickbench_q34/duckdb:vortex-file-compressed 1187383440 1210307438 0.98
clickbench_q35/duckdb:vortex-file-compressed 375411072 378762869 0.99
clickbench_q36/duckdb:vortex-file-compressed 25736759 24072252 1.07
clickbench_q37/duckdb:vortex-file-compressed 17194913 17071738 1.01
clickbench_q38/duckdb:vortex-file-compressed 19626174 18855608 1.04
clickbench_q39/duckdb:vortex-file-compressed 41889691 40333251 1.04
clickbench_q40/duckdb:vortex-file-compressed 16840085 16414413 1.03
clickbench_q41/duckdb:vortex-file-compressed 17175823 16751498 1.03
clickbench_q42/duckdb:vortex-file-compressed 19338900 19777416 0.98
duckdb / parquet (1.052x ➖, 0↑ 10↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22946454 23416162 0.98
clickbench_q01/duckdb:parquet 29148512 28465924 1.02
clickbench_q02/duckdb:parquet 50125454 50376383 1.00
clickbench_q03/duckdb:parquet 39605192 39907447 0.99
clickbench_q04/duckdb:parquet 202898179 200592341 1.01
clickbench_q05/duckdb:parquet 260319234 257939608 1.01
clickbench_q06/duckdb:parquet 47704541 47499783 1.00
clickbench_q07/duckdb:parquet 31460628 31386602 1.00
clickbench_q08/duckdb:parquet 272453011 268994216 1.01
clickbench_q09/duckdb:parquet 400693848 399007960 1.00
clickbench_q10/duckdb:parquet 80610756 83235761 0.97
clickbench_q11/duckdb:parquet 101385315 100309665 1.01
clickbench_q12/duckdb:parquet 286976093 282704213 1.02
clickbench_q13/duckdb:parquet 474509411 474379887 1.00
clickbench_q14/duckdb:parquet 345654072 314547918 1.10
clickbench_q15/duckdb:parquet 🚨 291794361 256183809 1.14
clickbench_q16/duckdb:parquet 🚨 686044251 596063523 1.15
clickbench_q17/duckdb:parquet 🚨 583853415 501023076 1.17
clickbench_q18/duckdb:parquet 🚨 1225118173 1030785654 1.19
clickbench_q19/duckdb:parquet 🚨 32099837 27936571 1.15
clickbench_q20/duckdb:parquet 🚨 466690439 420645372 1.11
clickbench_q21/duckdb:parquet 🚨 594969932 535445468 1.11
clickbench_q22/duckdb:parquet 1008876061 924332022 1.09
clickbench_q23/duckdb:parquet 281904504 261917317 1.08
clickbench_q24/duckdb:parquet 72668688 70515196 1.03
clickbench_q25/duckdb:parquet 171898486 162162311 1.06
clickbench_q26/duckdb:parquet 59159831 56076325 1.05
clickbench_q27/duckdb:parquet 691981392 637559300 1.09
clickbench_q28/duckdb:parquet 4939746730 4883113355 1.01
clickbench_q29/duckdb:parquet 42103905 41712573 1.01
clickbench_q30/duckdb:parquet 308287807 311916907 0.99
clickbench_q31/duckdb:parquet 373837051 374281927 1.00
clickbench_q32/duckdb:parquet 1155946122 1102572716 1.05
clickbench_q33/duckdb:parquet 🚨 1328298112 1097895904 1.21
clickbench_q34/duckdb:parquet 🚨 1361899320 1151931302 1.18
clickbench_q35/duckdb:parquet 🚨 418076516 369358190 1.13
clickbench_q36/duckdb:parquet 49393350 48295018 1.02
clickbench_q37/duckdb:parquet 35976347 35361681 1.02
clickbench_q38/duckdb:parquet 38333503 39840260 0.96
clickbench_q39/duckdb:parquet 83513425 86167665 0.97
clickbench_q40/duckdb:parquet 21715067 20528970 1.06
clickbench_q41/duckdb:parquet 22417712 20655229 1.09
clickbench_q42/duckdb:parquet 23075852 21697107 1.06
duckdb / duckdb (0.959x ➖, 5↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17346039 21590146 0.80
clickbench_q01/duckdb:duckdb 🚀 34190788 38935563 0.88
clickbench_q02/duckdb:duckdb 51111283 56437281 0.91
clickbench_q03/duckdb:duckdb 55800435 58931790 0.95
clickbench_q04/duckdb:duckdb 212252387 225059523 0.94
clickbench_q05/duckdb:duckdb 282808019 297713951 0.95
clickbench_q06/duckdb:duckdb 🚀 33616406 39225287 0.86
clickbench_q07/duckdb:duckdb 🚀 35030466 39782897 0.88
clickbench_q08/duckdb:duckdb 272483177 289449492 0.94
clickbench_q09/duckdb:duckdb 396102362 395318748 1.00
clickbench_q10/duckdb:duckdb 115924825 119496803 0.97
clickbench_q11/duckdb:duckdb 125705600 129325636 0.97
clickbench_q12/duckdb:duckdb 257410186 262085545 0.98
clickbench_q13/duckdb:duckdb 441801673 445440660 0.99
clickbench_q14/duckdb:duckdb 285257661 287950775 0.99
clickbench_q15/duckdb:duckdb 240781394 245808744 0.98
clickbench_q16/duckdb:duckdb 559468557 559273722 1.00
clickbench_q17/duckdb:duckdb 469867205 472625385 0.99
clickbench_q18/duckdb:duckdb 985083190 988993226 1.00
clickbench_q19/duckdb:duckdb 33989754 37703827 0.90
clickbench_q20/duckdb:duckdb 474037749 455911006 1.04
clickbench_q21/duckdb:duckdb 480177448 468968308 1.02
clickbench_q22/duckdb:duckdb 539063700 538082196 1.00
clickbench_q23/duckdb:duckdb 260433190 250732019 1.04
clickbench_q24/duckdb:duckdb 60628342 63949907 0.95
clickbench_q25/duckdb:duckdb 149141874 151900086 0.98
clickbench_q26/duckdb:duckdb 63517478 63995218 0.99
clickbench_q27/duckdb:duckdb 565794446 550123285 1.03
clickbench_q28/duckdb:duckdb 4561664501 4502922290 1.01
clickbench_q29/duckdb:duckdb 50279701 54086441 0.93
clickbench_q30/duckdb:duckdb 275501340 283460203 0.97
clickbench_q31/duckdb:duckdb 360307978 372215614 0.97
clickbench_q32/duckdb:duckdb 1119386762 1110344149 1.01
clickbench_q33/duckdb:duckdb 1132658718 1098030387 1.03
clickbench_q34/duckdb:duckdb 1220803023 1181369460 1.03
clickbench_q35/duckdb:duckdb 301323661 301263568 1.00
clickbench_q36/duckdb:duckdb 50791994 53474243 0.95
clickbench_q37/duckdb:duckdb 28955091 32169788 0.90
clickbench_q38/duckdb:duckdb 34087179 36949759 0.92
clickbench_q39/duckdb:duckdb 82176111 87539596 0.94
clickbench_q40/duckdb:duckdb 🚀 28345802 31591157 0.90
clickbench_q41/duckdb:duckdb 27676554 30529609 0.91
clickbench_q42/duckdb:duckdb 29940030 32886741 0.91
File Size Changes (106 files changed, -0.0% overall, 50↑ 56↓)
File Scale Format Base HEAD Change %
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_52.vortex 1.0 vortex-file-compressed 105.15 MB 105.45 MB +308.48 KB +0.3%
hits_82.vortex 1.0 vortex-file-compressed 99.83 MB 100.11 MB +286.73 KB +0.3%
hits_21.vortex 1.0 vortex-compact 51.39 MB 51.53 MB +144.64 KB +0.3%
hits_21.vortex 1.0 vortex-file-compressed 93.97 MB 94.22 MB +257.87 KB +0.3%
hits_25.vortex 1.0 vortex-file-compressed 113.81 MB 114.11 MB +308.01 KB +0.3%
hits_57.vortex 1.0 vortex-file-compressed 128.23 MB 128.54 MB +314.08 KB +0.2%
hits_2.vortex 1.0 vortex-file-compressed 186.50 MB 186.93 MB +441.59 KB +0.2%
hits_17.vortex 1.0 vortex-file-compressed 87.46 MB 87.65 MB +193.83 KB +0.2%
hits_29.vortex 1.0 vortex-compact 36.50 MB 36.57 MB +76.70 KB +0.2%
hits_4.vortex 1.0 vortex-file-compressed 108.66 MB 108.87 MB +214.84 KB +0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.86 MB 86.00 MB +150.28 KB +0.2%
hits_91.vortex 1.0 vortex-file-compressed 97.25 MB 97.40 MB +157.04 KB +0.2%
hits_74.vortex 1.0 vortex-file-compressed 119.84 MB 120.02 MB +177.83 KB +0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.36 MB 111.51 MB +157.20 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.85 MB 91.97 MB +124.70 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 78.58 MB 78.68 MB +104.69 KB +0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.26 MB 99.38 MB +114.33 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.85 MB 101.96 MB +111.03 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.45 MB 138.59 MB +144.63 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.72 MB 138.84 MB +120.91 KB +0.1%
hits_95.vortex 1.0 vortex-file-compressed 96.56 MB 96.63 MB +79.38 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.42 MB 110.50 MB +87.53 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.39 MB 111.46 MB +77.00 KB +0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.12 MB 115.20 MB +77.48 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.56 MB 168.66 MB +111.32 KB +0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.60 MB 73.64 MB +45.96 KB +0.1%
hits_3.vortex 1.0 vortex-file-compressed 142.32 MB 142.40 MB +87.73 KB +0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.20 MB 93.25 MB +50.02 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.56 MB 184.64 MB +78.64 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.11 MB 123.16 MB +50.49 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.74 MB 135.79 MB +43.57 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.35 MB 179.40 MB +50.54 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.35 MB 69.37 MB +18.66 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 123.09 MB 123.12 MB +31.30 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.82 MB 97.84 MB +22.47 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 80.01 MB +13.23 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 142.06 MB 142.08 MB +19.68 KB +0.0%
hits_10.vortex 1.0 vortex-file-compressed 69.70 MB 69.71 MB +8.50 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.17 MB 224.19 MB +25.82 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.33 MB +4.29 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.06 MB 110.07 MB +9.50 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.42 MB +18.74 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.14 MB 87.14 MB +7.32 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.96 MB 62.96 MB +4.13 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.78 MB 100.79 MB +3.40 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.69 MB 93.69 MB +1.57 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.34 MB 122.34 MB +768 B +0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.26 MB 81.26 MB +432 B +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.87 MB 104.87 MB 512 B -0.0%
hits_67.vortex 1.0 vortex-file-compressed 184.26 MB 184.26 MB 3.25 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.43 MB 103.43 MB 2.97 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.62 MB 277.60 MB 16.11 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.82 MB 59.82 MB 4.92 KB -0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.42 MB 118.41 MB 10.27 KB -0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.45 MB 227.43 MB 27.14 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.27 MB 90.26 MB 12.28 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.44 MB 69.43 MB 9.98 KB -0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.31 MB 89.30 MB 13.99 KB -0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.85 MB 66.84 MB 11.35 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.38 MB 164.35 MB 30.66 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.88 MB 119.85 MB 23.85 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.03 MB 6.19 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.89 MB 146.86 MB 32.77 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.32 MB 101.29 MB 25.97 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.47 MB 77.45 MB 24.95 KB -0.0%
hits_5.vortex 1.0 vortex-file-compressed 93.02 MB 92.99 MB 31.93 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.13 MB 122.08 MB 46.80 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.44 MB 69.41 MB 30.70 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.96 MB 77.92 MB 36.91 KB -0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.26 MB 223.12 MB 142.99 KB -0.1%
hits_55.vortex 1.0 vortex-file-compressed 169.33 MB 169.22 MB 112.71 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.91 MB 117.82 MB 87.23 KB -0.1%
hits_80.vortex 1.0 vortex-file-compressed 104.98 MB 104.90 MB 78.10 KB -0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.29 MB 57.24 MB 43.66 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.67 MB 123.57 MB 98.80 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 187.04 MB 186.89 MB 152.62 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.68 MB 89.61 MB 73.60 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.89 MB 84.82 MB 72.05 KB -0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.65 MB 172.50 MB 146.93 KB -0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.05 MB 93.96 MB 85.83 KB -0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.66 MB 90.58 MB 83.23 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.41 MB 80.33 MB 78.91 KB -0.1%
hits_71.vortex 1.0 vortex-file-compressed 102.17 MB 102.07 MB 100.32 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.35 MB 63.29 MB 64.70 KB -0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.12 MB 101.02 MB 104.01 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.29 MB 145.12 MB 173.86 KB -0.1%
hits_65.vortex 1.0 vortex-file-compressed 183.84 MB 183.61 MB 231.01 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.34 MB 99.22 MB 125.11 KB -0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.38 MB 99.25 MB 128.18 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.51 MB 90.40 MB 119.33 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.57 MB 114.42 MB 154.27 KB -0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.92 MB 89.80 MB 122.33 KB -0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.18 MB 90.04 MB 144.81 KB -0.2%
hits_6.vortex 1.0 vortex-file-compressed 93.44 MB 93.29 MB 154.38 KB -0.2%
hits_36.vortex 1.0 vortex-file-compressed 68.51 MB 68.40 MB 115.16 KB -0.2%
hits_62.vortex 1.0 vortex-file-compressed 117.64 MB 117.43 MB 222.51 KB -0.2%
hits_97.vortex 1.0 vortex-file-compressed 107.30 MB 107.03 MB 276.55 KB -0.3%
hits_16.vortex 1.0 vortex-file-compressed 80.23 MB 80.03 MB 209.30 KB -0.3%
hits_68.vortex 1.0 vortex-file-compressed 123.46 MB 123.15 MB 322.41 KB -0.3%
hits_49.vortex 1.0 vortex-file-compressed 76.07 MB 75.85 MB 229.22 KB -0.3%
hits_84.vortex 1.0 vortex-file-compressed 117.56 MB 117.20 MB 364.12 KB -0.3%
hits_53.vortex 1.0 vortex-file-compressed 87.71 MB 87.31 MB 410.33 KB -0.5%
hits_55.vortex 1.0 vortex-compact 96.04 MB 94.94 MB 1.09 MB -1.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.5%
Engines: DataFusion No clear signal (+16.9%, environment too noisy confidence) · DuckDB No clear signal (-4.8%, environment too noisy confidence)
Vortex (geomean): 1.053x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.102x ➖, 0↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 282425375 256479452 1.10
tpch_q02/datafusion:vortex-file-compressed 542571080 467868318 1.16
tpch_q03/datafusion:vortex-file-compressed 🚨 663569509 493029655 1.35
tpch_q04/datafusion:vortex-file-compressed 308465366 267885526 1.15
tpch_q05/datafusion:vortex-file-compressed 510681645 442142066 1.16
tpch_q06/datafusion:vortex-file-compressed 339291903 345413503 0.98
tpch_q07/datafusion:vortex-file-compressed 528601128 446081898 1.18
tpch_q08/datafusion:vortex-file-compressed 765503412 689064468 1.11
tpch_q09/datafusion:vortex-file-compressed 🚨 573243866 425308282 1.35
tpch_q10/datafusion:vortex-file-compressed 518724899 539103867 0.96
tpch_q11/datafusion:vortex-file-compressed 314380072 293944952 1.07
tpch_q12/datafusion:vortex-file-compressed 482538309 452271455 1.07
tpch_q13/datafusion:vortex-file-compressed 158434410 157994890 1.00
tpch_q14/datafusion:vortex-file-compressed 292164165 226199080 1.29
tpch_q15/datafusion:vortex-file-compressed 524665529 485903070 1.08
tpch_q16/datafusion:vortex-file-compressed 258182107 216464387 1.19
tpch_q17/datafusion:vortex-file-compressed 417624782 359197278 1.16
tpch_q18/datafusion:vortex-file-compressed 358095201 361401657 0.99
tpch_q19/datafusion:vortex-file-compressed 462509660 482144757 0.96
tpch_q20/datafusion:vortex-file-compressed 424270298 421643117 1.01
tpch_q21/datafusion:vortex-file-compressed 759338257 644977713 1.18
tpch_q22/datafusion:vortex-file-compressed 123255298 138523886 0.89
datafusion / vortex-compact (1.237x ➖, 0↑ 7↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 277889946 266094675 1.04
tpch_q02/datafusion:vortex-compact 482371759 433110893 1.11
tpch_q03/datafusion:vortex-compact 471471255 396506380 1.19
tpch_q04/datafusion:vortex-compact 🚨 337238545 212063096 1.59
tpch_q05/datafusion:vortex-compact 🚨 463576927 346592726 1.34
tpch_q06/datafusion:vortex-compact 🚨 509216053 265769108 1.92
tpch_q07/datafusion:vortex-compact 🚨 594124852 408061613 1.46
tpch_q08/datafusion:vortex-compact 714168585 593628791 1.20
tpch_q09/datafusion:vortex-compact 474274391 429903765 1.10
tpch_q10/datafusion:vortex-compact 456406866 388499561 1.17
tpch_q11/datafusion:vortex-compact 324530859 272324037 1.19
tpch_q12/datafusion:vortex-compact 465912153 363851916 1.28
tpch_q13/datafusion:vortex-compact 🚨 183041464 114050718 1.60
tpch_q14/datafusion:vortex-compact 🚨 355531980 260475649 1.36
tpch_q15/datafusion:vortex-compact 🚨 520267564 389380641 1.34
tpch_q16/datafusion:vortex-compact 199858115 191486687 1.04
tpch_q17/datafusion:vortex-compact 446017919 376133852 1.19
tpch_q18/datafusion:vortex-compact 301547562 303768554 0.99
tpch_q19/datafusion:vortex-compact 521896242 482392574 1.08
tpch_q20/datafusion:vortex-compact 498742212 430940675 1.16
tpch_q21/datafusion:vortex-compact 593652000 587215744 1.01
tpch_q22/datafusion:vortex-compact 130470538 107471209 1.21
datafusion / parquet (0.999x ➖, 0↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 247344086 240969353 1.03
tpch_q02/datafusion:parquet 418724746 426946643 0.98
tpch_q03/datafusion:parquet 340930345 459442833 0.74
tpch_q04/datafusion:parquet 169965502 217698850 0.78
tpch_q05/datafusion:parquet 562521631 472296416 1.19
tpch_q06/datafusion:parquet 232390168 179918918 1.29
tpch_q07/datafusion:parquet 605213874 492967213 1.23
tpch_q08/datafusion:parquet 678780476 602847283 1.13
tpch_q09/datafusion:parquet 521014793 461784299 1.13
tpch_q10/datafusion:parquet 602202746 516232896 1.17
tpch_q11/datafusion:parquet 319269220 342053479 0.93
tpch_q12/datafusion:parquet 222030355 247867753 0.90
tpch_q13/datafusion:parquet 429580022 434229308 0.99
tpch_q14/datafusion:parquet 168851853 220809933 0.76
tpch_q15/datafusion:parquet 298388940 405318223 0.74
tpch_q16/datafusion:parquet 161889434 170757238 0.95
tpch_q17/datafusion:parquet 418126745 421160659 0.99
tpch_q18/datafusion:parquet 491617576 454284472 1.08
tpch_q19/datafusion:parquet 449832763 359829863 1.25
tpch_q20/datafusion:parquet 🚨 451305994 342681775 1.32
tpch_q21/datafusion:parquet 640307526 696434506 0.92
tpch_q22/datafusion:parquet 134774362 161212774 0.84
duckdb / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 284616816 263986719 1.08
tpch_q02/duckdb:vortex-file-compressed 976123048 1030436913 0.95
tpch_q03/duckdb:vortex-file-compressed 657591311 636460481 1.03
tpch_q04/duckdb:vortex-file-compressed 435733544 431819088 1.01
tpch_q05/duckdb:vortex-file-compressed 927699785 882405367 1.05
tpch_q06/duckdb:vortex-file-compressed 350526072 353162625 0.99
tpch_q07/duckdb:vortex-file-compressed 968017211 915619990 1.06
tpch_q08/duckdb:vortex-file-compressed 999161640 1055148518 0.95
tpch_q09/duckdb:vortex-file-compressed 917322501 966071695 0.95
tpch_q10/duckdb:vortex-file-compressed 798666157 817696567 0.98
tpch_q11/duckdb:vortex-file-compressed 514659182 525237938 0.98
tpch_q12/duckdb:vortex-file-compressed 740700602 844093901 0.88
tpch_q13/duckdb:vortex-file-compressed 420868785 504802766 0.83
tpch_q14/duckdb:vortex-file-compressed 424424629 415958533 1.02
tpch_q15/duckdb:vortex-file-compressed 316857599 284559997 1.11
tpch_q16/duckdb:vortex-file-compressed 342087978 324260088 1.05
tpch_q17/duckdb:vortex-file-compressed 708385336 794880245 0.89
tpch_q18/duckdb:vortex-file-compressed 618380649 670450500 0.92
tpch_q19/duckdb:vortex-file-compressed 463567109 538308510 0.86
tpch_q20/duckdb:vortex-file-compressed 787480923 828447589 0.95
tpch_q21/duckdb:vortex-file-compressed 1034732762 1187910402 0.87
tpch_q22/duckdb:vortex-file-compressed 302455335 285122588 1.06
duckdb / vortex-compact (0.926x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 292206351 299605223 0.98
tpch_q02/duckdb:vortex-compact 892026075 1026805344 0.87
tpch_q03/duckdb:vortex-compact 629258830 716572149 0.88
tpch_q04/duckdb:vortex-compact 341993568 455222517 0.75
tpch_q05/duckdb:vortex-compact 813842577 849705985 0.96
tpch_q06/duckdb:vortex-compact 343245335 358186475 0.96
tpch_q07/duckdb:vortex-compact 902093843 990782699 0.91
tpch_q08/duckdb:vortex-compact 989903520 972613736 1.02
tpch_q09/duckdb:vortex-compact 943743102 994885421 0.95
tpch_q10/duckdb:vortex-compact 739861501 728998830 1.01
tpch_q11/duckdb:vortex-compact 496777982 539765775 0.92
tpch_q12/duckdb:vortex-compact 610816657 672163957 0.91
tpch_q13/duckdb:vortex-compact 379511600 431040278 0.88
tpch_q14/duckdb:vortex-compact 382299486 400265044 0.96
tpch_q15/duckdb:vortex-compact 309930461 334041437 0.93
tpch_q16/duckdb:vortex-compact 338191227 394594262 0.86
tpch_q17/duckdb:vortex-compact 669091793 773731208 0.86
tpch_q18/duckdb:vortex-compact 526820220 509404104 1.03
tpch_q19/duckdb:vortex-compact 482918085 480890704 1.00
tpch_q20/duckdb:vortex-compact 772154536 803855631 0.96
tpch_q21/duckdb:vortex-compact 990426885 1033605084 0.96
tpch_q22/duckdb:vortex-compact 285265495 330483744 0.86
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 431345589 441278955 0.98
tpch_q02/duckdb:parquet 1057634184 1099752653 0.96
tpch_q03/duckdb:parquet 998886924 1011927630 0.99
tpch_q04/duckdb:parquet 702325779 699010170 1.00
tpch_q05/duckdb:parquet 1240510256 1320519604 0.94
tpch_q06/duckdb:parquet 429611978 419076568 1.03
tpch_q07/duckdb:parquet 1187110959 1125926092 1.05
tpch_q08/duckdb:parquet 1564872480 1408276097 1.11
tpch_q09/duckdb:parquet 1404009692 1359980628 1.03
tpch_q10/duckdb:parquet 1385413828 1297568602 1.07
tpch_q11/duckdb:parquet 718314878 760284505 0.94
tpch_q12/duckdb:parquet 653873597 748960415 0.87
tpch_q13/duckdb:parquet 898963179 944313298 0.95
tpch_q14/duckdb:parquet 723326132 710175773 1.02
tpch_q15/duckdb:parquet 518700695 500285955 1.04
tpch_q16/duckdb:parquet 666270954 662770662 1.01
tpch_q17/duckdb:parquet 829150705 777564972 1.07
tpch_q18/duckdb:parquet 988021681 940627857 1.05
tpch_q19/duckdb:parquet 787243268 780712148 1.01
tpch_q20/duckdb:parquet 1126233412 1233770557 0.91
tpch_q21/duckdb:parquet 1028610826 1061460749 0.97
tpch_q22/duckdb:parquet 572923367 590217522 0.97

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): 0.976x ➖
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.953x ➖, 1↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 130232664 141761463 0.92
appian_q02/datafusion:vortex-file-compressed 665785605 676857269 0.98
appian_q03/datafusion:vortex-file-compressed 363413923 381997645 0.95
appian_q04/datafusion:vortex-file-compressed 27998007532 28248786397 0.99
appian_q05/datafusion:vortex-file-compressed 263148730 277069102 0.95
appian_q06/datafusion:vortex-file-compressed 416186505 433463540 0.96
appian_q07/datafusion:vortex-file-compressed 457326433 465601469 0.98
appian_q08/datafusion:vortex-file-compressed 🚀 1871775667 2099423338 0.89
datafusion / parquet (0.955x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 132313187 145635373 0.91
appian_q02/datafusion:parquet 673497874 721158018 0.93
appian_q03/datafusion:parquet 358429516 385998361 0.93
appian_q04/datafusion:parquet 27806442515 28797979626 0.97
appian_q05/datafusion:parquet 289027613 298768700 0.97
appian_q06/datafusion:parquet 432982607 440048402 0.98
appian_q07/datafusion:parquet 462526801 471071429 0.98
appian_q08/datafusion:parquet 1842443048 1895509342 0.97
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 192653672 191897230 1.00
appian_q02/duckdb:vortex-file-compressed 611739318 609098993 1.00
appian_q03/duckdb:vortex-file-compressed 260515885 259411249 1.00
appian_q04/duckdb:vortex-file-compressed 1326409444 1336287405 0.99
appian_q05/duckdb:vortex-file-compressed 288329334 290848394 0.99
appian_q06/duckdb:vortex-file-compressed 801121434 808447827 0.99
appian_q07/duckdb:vortex-file-compressed 342808418 339419357 1.01
appian_q08/duckdb:vortex-file-compressed 1303733230 1299443531 1.00
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 200908129 203204768 0.99
appian_q02/duckdb:parquet 600035152 608921836 0.99
appian_q03/duckdb:parquet 286551847 285016939 1.01
appian_q04/duckdb:parquet 1334018400 1324220034 1.01
appian_q05/duckdb:parquet 313879894 311642711 1.01
appian_q06/duckdb:parquet 795872845 799982147 0.99
appian_q07/duckdb:parquet 364690910 362925484 1.00
appian_q08/duckdb:parquet 1269605939 1272040290 1.00
duckdb / duckdb (0.994x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 172180571 171271975 1.01
appian_q02/duckdb:duckdb 546747896 550533648 0.99
appian_q03/duckdb:duckdb 392265695 395217794 0.99
appian_q04/duckdb:duckdb 1301882075 1310596557 0.99
appian_q05/duckdb:duckdb 279839550 283066106 0.99
appian_q06/duckdb:duckdb 782247776 794938884 0.98
appian_q07/duckdb:duckdb 324725796 325297147 1.00
appian_q08/duckdb:duckdb 1218316276 1218017251 1.00
File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
creditcardview.vortex 1.0 vortex-file-compressed 60.97 MB 61.01 MB +41.14 KB +0.1%
orderview.vortex 1.0 vortex-file-compressed 81.05 MB 81.06 MB +10.33 KB +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 16 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.64 MB → 513.69 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.1%
Engines: DataFusion No clear signal (-10.0%, environment too noisy confidence) · DuckDB No clear signal (-2.1%, environment too noisy confidence)
Vortex (geomean): 0.969x ➖
Parquet (geomean): 1.033x ➖
Shifts: Parquet (control) +3.3% · Median polish -5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.034x ➖, 0↑ 2↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 693924009 680995535 1.02
tpch_q02/datafusion:vortex-file-compressed 741804517 749950058 0.99
tpch_q03/datafusion:vortex-file-compressed 🚨 1097652448 815582696 1.35
tpch_q04/datafusion:vortex-file-compressed 645471726 612844507 1.05
tpch_q05/datafusion:vortex-file-compressed 1024247872 1003581200 1.02
tpch_q06/datafusion:vortex-file-compressed 598224173 588483490 1.02
tpch_q07/datafusion:vortex-file-compressed 1103194384 1083100577 1.02
tpch_q08/datafusion:vortex-file-compressed 1332956329 1443183272 0.92
tpch_q09/datafusion:vortex-file-compressed 1266747801 1458435390 0.87
tpch_q10/datafusion:vortex-file-compressed 1004774582 1025465162 0.98
tpch_q11/datafusion:vortex-file-compressed 420427231 446621374 0.94
tpch_q12/datafusion:vortex-file-compressed 829057407 1077035359 0.77
tpch_q13/datafusion:vortex-file-compressed 435675881 429340834 1.01
tpch_q14/datafusion:vortex-file-compressed 543336422 578905753 0.94
tpch_q15/datafusion:vortex-file-compressed 928808489 899610947 1.03
tpch_q16/datafusion:vortex-file-compressed 369732128 347739066 1.06
tpch_q17/datafusion:vortex-file-compressed 1198385577 1193730642 1.00
tpch_q18/datafusion:vortex-file-compressed 1495778987 1286924410 1.16
tpch_q19/datafusion:vortex-file-compressed 919235433 783198224 1.17
tpch_q20/datafusion:vortex-file-compressed 🚨 1104025711 828039430 1.33
tpch_q21/datafusion:vortex-file-compressed 1837390766 1743707251 1.05
tpch_q22/datafusion:vortex-file-compressed 471238260 394243287 1.20
datafusion / vortex-compact (0.962x ➖, 0↑ 1↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 687123519 708696399 0.97
tpch_q02/datafusion:vortex-compact 🚨 943262368 685004623 1.38
tpch_q03/datafusion:vortex-compact 907323499 745153069 1.22
tpch_q04/datafusion:vortex-compact 520063846 506666364 1.03
tpch_q05/datafusion:vortex-compact 828120475 951261551 0.87
tpch_q06/datafusion:vortex-compact 540396156 527517241 1.02
tpch_q07/datafusion:vortex-compact 914609050 1142573541 0.80
tpch_q08/datafusion:vortex-compact 1399031005 1318032086 1.06
tpch_q09/datafusion:vortex-compact 1671480235 1462906134 1.14
tpch_q10/datafusion:vortex-compact 941599712 1230154382 0.77
tpch_q11/datafusion:vortex-compact 560414784 617102588 0.91
tpch_q12/datafusion:vortex-compact 876473677 854490371 1.03
tpch_q13/datafusion:vortex-compact 435380861 469673795 0.93
tpch_q14/datafusion:vortex-compact 564362317 502317524 1.12
tpch_q15/datafusion:vortex-compact 959875556 938767164 1.02
tpch_q16/datafusion:vortex-compact 405760711 430548893 0.94
tpch_q17/datafusion:vortex-compact 1155864657 1235536545 0.94
tpch_q18/datafusion:vortex-compact 1133433787 1142434233 0.99
tpch_q19/datafusion:vortex-compact 749650778 873960866 0.86
tpch_q20/datafusion:vortex-compact 842061649 961834834 0.88
tpch_q21/datafusion:vortex-compact 1399549914 1848212898 0.76
tpch_q22/datafusion:vortex-compact 442320667 569610021 0.78
datafusion / parquet (1.108x ➖, 0↑ 3↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 892553169 826257138 1.08
tpch_q02/datafusion:parquet 1086204097 880160397 1.23
tpch_q03/datafusion:parquet 1044494788 922283049 1.13
tpch_q04/datafusion:parquet 505053083 449912749 1.12
tpch_q05/datafusion:parquet 1234679148 1146167424 1.08
tpch_q06/datafusion:parquet 572667420 511552374 1.12
tpch_q07/datafusion:parquet 1356045278 1192239671 1.14
tpch_q08/datafusion:parquet 1624901178 1521346416 1.07
tpch_q09/datafusion:parquet 1709058774 1779851241 0.96
tpch_q10/datafusion:parquet 🚨 2685957176 2046636902 1.31
tpch_q11/datafusion:parquet 🚨 723399371 496282923 1.46
tpch_q12/datafusion:parquet 759672929 651010064 1.17
tpch_q13/datafusion:parquet 812711027 706871013 1.15
tpch_q14/datafusion:parquet 768890179 836853804 0.92
tpch_q15/datafusion:parquet 1291701264 1266884068 1.02
tpch_q16/datafusion:parquet 392995159 385522756 1.02
tpch_q17/datafusion:parquet 1415488771 1312817420 1.08
tpch_q18/datafusion:parquet 1722619971 1527556752 1.13
tpch_q19/datafusion:parquet 952617649 969557936 0.98
tpch_q20/datafusion:parquet 1163456343 1150227830 1.01
tpch_q21/datafusion:parquet 1913116128 1898079821 1.01
tpch_q22/datafusion:parquet 🚨 931978154 693247301 1.34
duckdb / vortex-file-compressed (0.927x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 589245159 649403318 0.91
tpch_q02/duckdb:vortex-file-compressed 1127689011 1210959439 0.93
tpch_q03/duckdb:vortex-file-compressed 919641301 978449386 0.94
tpch_q04/duckdb:vortex-file-compressed 747582305 786191134 0.95
tpch_q05/duckdb:vortex-file-compressed 1086831276 1288483939 0.84
tpch_q06/duckdb:vortex-file-compressed 574895168 570408117 1.01
tpch_q07/duckdb:vortex-file-compressed 1248069459 1240986991 1.01
tpch_q08/duckdb:vortex-file-compressed 1445266185 1570163469 0.92
tpch_q09/duckdb:vortex-file-compressed 1789679038 1841110066 0.97
tpch_q10/duckdb:vortex-file-compressed 1158407225 1252091710 0.93
tpch_q11/duckdb:vortex-file-compressed 697972925 699829273 1.00
tpch_q12/duckdb:vortex-file-compressed 1128128498 1372885278 0.82
tpch_q13/duckdb:vortex-file-compressed 845401021 868431881 0.97
tpch_q14/duckdb:vortex-file-compressed 613577429 684588357 0.90
tpch_q15/duckdb:vortex-file-compressed 526683254 579413709 0.91
tpch_q16/duckdb:vortex-file-compressed 540519794 544224627 0.99
tpch_q17/duckdb:vortex-file-compressed 968153328 1060224571 0.91
tpch_q18/duckdb:vortex-file-compressed 942652264 986039841 0.96
tpch_q19/duckdb:vortex-file-compressed 739656133 828937610 0.89
tpch_q20/duckdb:vortex-file-compressed 1244601115 1389992435 0.90
tpch_q21/duckdb:vortex-file-compressed 2026882513 2140205856 0.95
tpch_q22/duckdb:vortex-file-compressed 438623413 531419157 0.83
duckdb / vortex-compact (0.958x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 622287894 681376049 0.91
tpch_q02/duckdb:vortex-compact 1009648965 1178138024 0.86
tpch_q03/duckdb:vortex-compact 782612867 954011785 0.82
tpch_q04/duckdb:vortex-compact 581333712 559461941 1.04
tpch_q05/duckdb:vortex-compact 1138952450 1244784855 0.91
tpch_q06/duckdb:vortex-compact 529598025 572643542 0.92
tpch_q07/duckdb:vortex-compact 1132973862 1129997135 1.00
tpch_q08/duckdb:vortex-compact 1445766091 1404684148 1.03
tpch_q09/duckdb:vortex-compact 1527760389 1670720523 0.91
tpch_q10/duckdb:vortex-compact 1035179444 1263916368 0.82
tpch_q11/duckdb:vortex-compact 672751631 746507010 0.90
tpch_q12/duckdb:vortex-compact 1046406562 1077053844 0.97
tpch_q13/duckdb:vortex-compact 862694743 932342942 0.93
tpch_q14/duckdb:vortex-compact 668932475 691494300 0.97
tpch_q15/duckdb:vortex-compact 547698189 591825411 0.93
tpch_q16/duckdb:vortex-compact 443884000 399029951 1.11
tpch_q17/duckdb:vortex-compact 936934136 944346784 0.99
tpch_q18/duckdb:vortex-compact 846668756 858242196 0.99
tpch_q19/duckdb:vortex-compact 795034571 771601502 1.03
tpch_q20/duckdb:vortex-compact 1346123685 1184958226 1.14
tpch_q21/duckdb:vortex-compact 1809582335 1875113803 0.97
tpch_q22/duckdb:vortex-compact 490334655 489959943 1.00
duckdb / parquet (0.962x ➖, 0↑ 0↓)
name PR b1d8275 (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 871550707 923941939 0.94
tpch_q02/duckdb:parquet 1358370199 1581689419 0.86
tpch_q03/duckdb:parquet 1750668960 1782834489 0.98
tpch_q04/duckdb:parquet 1097991888 1103264248 1.00
tpch_q05/duckdb:parquet 2133262053 2100248810 1.02
tpch_q06/duckdb:parquet 833218126 914085486 0.91
tpch_q07/duckdb:parquet 1913246577 1836279752 1.04
tpch_q08/duckdb:parquet 2309488344 2413264044 0.96
tpch_q09/duckdb:parquet 2547133199 2742150724 0.93
tpch_q10/duckdb:parquet 3222943697 3198172673 1.01
tpch_q11/duckdb:parquet 905602867 1028677066 0.88
tpch_q12/duckdb:parquet 1046526869 1329506129 0.79
tpch_q13/duckdb:parquet 1264799562 1349352353 0.94
tpch_q14/duckdb:parquet 1288297913 1225896565 1.05
tpch_q15/duckdb:parquet 1112048128 943970815 1.18
tpch_q16/duckdb:parquet 910630773 915991914 0.99
tpch_q17/duckdb:parquet 1298440343 1385712218 0.94
tpch_q18/duckdb:parquet 1681659474 1499917492 1.12
tpch_q19/duckdb:parquet 1498618606 1606814517 0.93
tpch_q20/duckdb:parquet 1940326244 2016013003 0.96
tpch_q21/duckdb:parquet 1651394905 1896258061 0.87
tpch_q22/duckdb:parquet 1088260486 1137246028 0.96

@AdamGS AdamGS merged commit 66335d4 into develop Jun 3, 2026
86 of 89 checks passed
@AdamGS AdamGS deleted the adamg/remove-full-details branch June 3, 2026 13:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@myrrc myrrc myrrc approved these changes
@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

Assignees

No one assigned

Labels

changelog/ci

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@AdamGS @myrrc